Thermal image sensor and user interface

ABSTRACT

A thermal image sensor including: a plurality of infrared detector elements that detect infrared light in a detection area; and rotors that scan the detection area in a scanning direction to detect, with the plurality of infrared detector elements, infrared light in an area to be captured as a single thermal image. The plurality of infrared detector elements include infrared detector elements arranged in mutually different positions in a rotational direction corresponding to the scanning direction of the plurality of infrared detector elements.

TECHNICAL FIELD

The present invention relates to thermal image sensors used in, forexample, air conditioners.

BACKGROUND ART

Recent years have seen the development of various devices which arecontrolled based on data obtained from the surrounding environment usinga variety of detectors. These devices use this data from the surroundingenvironment to provide a more comfortable living environment.

For example, a configuration in air conditioners is known which uses atemperature sensor to measure the temperature of air drawn into the airconditioner and feed back the measured temperature to the airconditioner. Air conditioners having this configuration adjust, forexample, fan speed based on the feedback temperature to adjust thetemperature of the room.

Known air conditioners also include those which use an infrared detectorto measure an amount of activity of a person in a room, and use themeasured data to provide a more comfortable air conditioning experience(for example, see Patent Literature (PTL) 1 and 2).

CITATION LIST Patent Literature

[PTL 1] Japanese Unexamined Patent Application Publication No.2010-133692

[PTL 2] Japanese Unexamined Patent Application Publication No.2010-216688

SUMMARY OF INVENTION Technical Problem

There is room for development regarding the configuration of theabove-described infrared detector (thermal image sensor).

The present invention provides a thermal image sensor suitable formeasuring an amount of activity.

Solution to Problem

In order to achieve this, a thermal image sensor according to one aspectof the present invention includes: a plurality of infrared detectorelements that detect infrared light in a detection area; and a scanningunit configured to scan the detection area in a scanning direction todetect, with the plurality of infrared detector elements, infrared lightin an area to be captured as a single thermal image, wherein theplurality of infrared detector elements include infrared detectorelements arranged in mutually different positions in a predetermineddirection corresponding to the scanning direction.

These general and specific aspects may be implemented using a system, amethod, an integrated circuit, a computer program, or acomputer-readable recording medium such as a CD-ROM, or any combinationof systems, methods, integrated circuits, computer programs, orcomputer-readable recording media.

Advantageous Effects of Invention

One aspect of the present invention provides a thermal image sensorsuitable for measuring an amount of activity.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is an external view of an air conditioner including a thermalimage sensor.

FIG. 2 illustrates an example of a thermal image sensor includinginfrared sensor elements arranged in a matrix.

FIG. 3 is a schematic view of a room monitored by a thermal imagesensor.

FIG. 4 illustrates the temperature distribution measurement methodemployed by the matrix thermal image sensor.

FIG. 5 illustrates an example of a thermal image sensor includinginfrared sensor elements arranged in a line.

FIG. 6 illustrates the temperature distribution measurement methodemployed by the linear thermal image sensor.

FIG. 7 is a block diagram illustrating the system configuration of anair conditioner including a thermal image sensor.

FIG. 8 is a block diagram illustrating the system configuration of anair conditioner including an external image processor.

FIG. 9 is a flow chart for determining a high-temperature phase and alow-temperature phase.

FIG. 10A is a first figure illustrating an example of how the locationof the entire observation area is changed based on the location of theuser.

FIG. 10B is a second figure illustrating an example of how the locationof the entire observation area is changed based on the location of theuser.

FIG. 11A is a first figure illustrating an example of a user interfaceof an air conditioner.

FIG. 11B is a second figure illustrating an example of a user interfaceof an air conditioner.

FIG. 11C is a third figure illustrating an example of a user interfaceof an air conditioner.

FIG. 11D is a block diagram illustrating a user interface of an airconditioner.

FIG. 12 is an external view of the thermal image sensor according toEmbodiment 2.

FIG. 13 illustrates the temperature distribution measurement methodemployed by the thermal image sensor according to Embodiment 2.

(a) in FIG. 14 illustrates the thermal image sensor according toVariation 1 of Embodiment 2, and (b) in FIG. 14 illustrates theobservation area of the thermal image sensor illustrated in (a) in FIG.14.

(a) and (b) in FIG. 15 illustrate the thermal image sensors according toVariation 2 of Embodiment 2, (c) in FIG. 15 illustrates the observationarea of the thermal image sensor illustrated in (a) in FIG. 15, and (d)in FIG. 15 illustrates the observation area of the thermal image sensorillustrated in (b) in FIG. 15.

(a) through (d) in FIG. 16 illustrate the thermal image sensorsaccording to Variation 3 of Embodiment 2, and (e) through (h) in FIG. 16illustrate the observation areas of the thermal image sensorsillustrated in (a) through (d) in FIG. 16.

(a) and (b) in FIG. 17 illustrate the thermal image sensors according toVariation 4 of Embodiment 2.

(a) and (b) in FIG. 18 illustrate the thermal image sensors according toVariation 5 of Embodiment 2.

(a) and (b) in FIG. 19 illustrate the thermal image sensors according toVariation 6 of Embodiment 2, and (c) and (d) in FIG. 19 illustrate theobservation areas of the thermal image sensors illustrated in (a) and(b) in FIG. 19.

(a) through (d) in FIG. 20 illustrate the thermal image sensorsaccording to Variation 7 of Embodiment 2, and (d) through (f) in FIG. 20illustrate the observation areas of the thermal image sensorsillustrated in (a) through (c) in FIG. 20.

FIG. 21 illustrates an example of a method for forming partialobservation pixels.

FIG. 22 illustrates a technique for achieving a high-quality image bypixel shifting.

FIG. 23 illustrates an example of observation areas when photosensorelement lines are shifted in the X axis direction.

FIG. 24 illustrates a technique for achieving a high-resolution imagewith baffles.

(a) in FIG. 25 illustrates the thermal image sensor according toVariation 8 of Embodiment 2, and (b) in FIG. 25 illustrates theobservation area of the thermal image sensor illustrated in (a) in FIG.25.

FIG. 26 illustrates an example of a different observation area accordingto Variation 8 of Embodiment 2.

FIG. 27 illustrates scanning in the Y axis direction.

FIG. 28 illustrates an example of an observation area when two or moredifferent sized photosensor elements are arranged in the thermal imagesensor according to Variation 8.

FIG. 29 illustrates an example of a thermal image sensor having aconfiguration in which the photosensor (photosensor elements) is causedto shift.

FIG. 30 illustrates an example of a thermal image sensor which performsscanning by moving a structural element other than the photosensor.

FIG. 31 illustrates a first example of the vehicle air conditioneraccording to Embodiment 3.

FIG. 32 illustrates a second example of the vehicle air conditioneraccording to Embodiment 3.

FIG. 33 illustrates an example of the user interface according toEmbodiment 3.

FIG. 34 illustrates a vehicle air conditioner having an observation areaincluding the windshield.

FIG. 35 is a flow chart for ventilation operation based on condensationprediction.

FIG. 36 is another example of a flow chart for ventilation operationbased on condensation prediction.

FIG. 37 illustrates a vehicle including a scattered light measurementsystem.

FIG. 38 is a diagrammatic view of a room in which an air conditionerincluding the infrared detector according to Embodiment 4 is installed.

FIG. 39A is a perspective view of the infrared detector according toEmbodiment 4.

FIG. 39B is a front view of the infrared detector according toEmbodiment 4.

FIG. 40A is a conceptual diagram illustrating detection areas of theinfrared detector according to Embodiment 4.

FIG. 40B is a conceptual diagram illustrating detection areas of theinfrared detector according to Embodiment 4.

FIG. 40C is a conceptual diagram illustrating detection areas of theinfrared detector according to Embodiment 4.

FIG. 40D is a conceptual diagram illustrating detection areas of theinfrared detector according to Embodiment 4.

FIG. 40E is a conceptual diagram illustrating detection areas of theinfrared detector according to Embodiment 4.

FIG. 41 is a perspective view of an infrared detector in which infrareddetector elements are arranged in a straight vertical line.

FIG. 42A is a conceptual diagram illustrating detection areas of theinfrared detector illustrated in FIG. 41.

FIG. 42B is a conceptual diagram illustrating detection areas of theinfrared detector illustrated in FIG. 41.

FIG. 42C is a conceptual diagram illustrating detection areas of theinfrared detector illustrated in FIG. 41.

FIG. 43A is a perspective view of the infrared detector according toVariation 1 of Embodiment 4.

FIG. 43B is a front view of the infrared detector according to Variation1 of Embodiment 4.

FIG. 44A is a perspective view of the infrared detector according toVariation 2 of Embodiment 4.

FIG. 44B is a front view of the infrared detector according to Variation2 of Embodiment 4.

FIG. 45 is a perspective view of the infrared detector according toVariation 3 of Embodiment 4.

FIG. 46 is a perspective view of an infrared detector in which animaging lens is attached to a mirror.

FIG. 47 is a perspective view of the infrared detector according toVariation 4 of Embodiment 4.

FIG. 48A is a conceptual diagram illustrating detection areas whenvertical scanning is performed.

FIG. 48B is a conceptual diagram illustrating detection areas whenvertical scanning is performed.

FIG. 48C is a conceptual diagram illustrating detection areas whenvertical scanning is performed.

FIG. 49 illustrates an example where a light is a detection target.

FIG. 50 is a conceptual diagram of detection areas when a light isdetected.

FIG. 51A is a perspective view of the infrared detector according toVariation 5 of Embodiment 4.

FIG. 51B is a top view of the infrared detector according to Variation 5of Embodiment 4.

FIG. 52 is a conceptual diagram of detection areas of the infrareddetector according to Variation 5 of Embodiment 4.

FIG. 53 illustrates a technique for increasing the resolution of aninfrared image.

FIG. 54 is a perspective view of the infrared detector according toVariation 6 of Embodiment 4.

FIG. 55 illustrates a technique for changing the resolution of aninfrared image.

FIG. 56 illustrates a technique for cutting an infrared detector elementarray from a wafer.

FIG. 57 is a diagrammatic view of a room in which a lighting deviceincluding an infrared detector is installed in the ceiling.

FIG. 58 illustrates an example of a thermal image sensor including aplurality of one-dimensional photosensors disposed adjacent to eachother.

DESCRIPTION OF EMBODIMENTS

A thermal image sensor according to one aspect of the present inventionincludes: a plurality of infrared detector elements that detect infraredlight in a detection area; and a scanning unit configured to scan thedetection area in a scanning direction to detect, with the plurality ofinfrared detector elements, infrared light in an area to be captured asa single thermal image, wherein the plurality of infrared detectorelements include infrared detector elements arranged in mutuallydifferent positions in a predetermined direction corresponding to thescanning direction.

The plurality of infrared detector elements may be aligned in anintersecting direction intersecting both the predetermined direction anda direction perpendicular to the predetermined direction.

The plurality of infrared detector elements may be arranged such that adetection range of one infrared detector element included in theplurality of infrared detector elements overlaps a detection range of anadjacent infrared detector element included in the plurality of infrareddetector elements.

Relative to the predetermined direction, an angle of the intersectingdirection in which the plurality of infrared detector elements arealigned may be 45 degrees.

the plurality of infrared detector elements may constitute a pluralityof element lines each configured of a portion of the plurality ofinfrared detector elements, and the plurality of element lines may bearranged in mutually different positions in the predetermined direction.

Each of the plurality of element lines may be configured of infrareddetector elements aligned in a direction perpendicular to thepredetermined direction.

The plurality of element lines may include: an element line of infrareddetector elements aligned in a direction perpendicular to thepredetermined direction; and an element line of infrared detectorelements aligned in an intersecting direction intersecting both thepredetermined direction and the direction perpendicular to thepredetermined direction.

A total number of infrared detector elements constituting one elementline included in the plurality of element lines may be different from atotal number of infrared detector elements constituting another elementline included in the plurality of element lines.

The plurality of infrared detector elements may include two types ofinfrared detector elements different in at least one of shape, thermalcapacity, size, or material.

The scanning unit may be configured to scan the detection area in thescanning direction by moving the plurality of infrared detector elementsin the predetermined direction.

The thermal image sensor may further include an optical system thatintroduces infrared light from a target object to the plurality ofinfrared detector elements. The scanning unit may be configured to scanthe detection area in the scanning direction by moving the opticalsystem.

The thermal image sensor may further include a perpendicular scanningunit configured to scan the detection range in a direction perpendicularto the scanning direction.

The thermal image sensor may further include a structure that adjusts anangle of the intersecting direction relative to the predetermineddirection by rotating the plurality of infrared detector elements.

According to one aspect of the present invention, a user interface foran air conditioner including a thermal image sensor for generating athermal image showing a temperature distribution of a target areaincludes: a first setting-receiving unit configured to receive a settingfor a target temperature of a room; and a second setting-receiving unitconfigured to receive a setting for a target temperature of a certainpart of the target area.

The user interface may further include a third setting-receiving unitconfigured to receive a setting for an air flow direction and a settingfor a fan speed for the air conditioner. When the setting for the targettemperature for the first setting-receiving unit is set and the settingfor the target temperature for the second setting-receiving unit is set,the third setting-receiving unit may be configured to refrain fromreceiving the setting for the air flow direction and the setting for thefan speed.

The user interface may further include a display unit configured todisplay at least the air flow direction and the fan speed. When thesetting for the target temperature for the first setting-receiving unitis set and the setting for the target temperature for the secondsetting-receiving unit is set, the display unit may be configured todisplay that input of a setting to the third setting-receiving unit isnot possible.

The air conditioner may detect a location of a person in the target areaby image processing by the thermal image sensor, and the display unitmay be further configured to display a temperature at the location ofthe person detected by the air conditioner.

The temperature at the location of the person may include at least oneof a temperature at a location of a face of the person, a temperature ata location of a hand of the person, or a temperature at a location of aleg of the person.

The second setting-receiving unit may be configured to receive, as thetarget temperature of the certain part, a setting for a targettemperature of at least one of a location of a face of the person, alocation of a hand of the person, ora location of a leg of the person.

The air conditioner according to one aspect of the present inventionincludes: a thermal image sensor that measures a temperature of asurrounding area and obtains a thermal image including a plurality ofpixels indicating a thermal distribution; an image processing unitconfigured to detect a location of a specific body part of a person fromthe thermal image obtained from the thermal image sensor; and a devicecontrol unit configured to control at least one of a air flow direction,a fan speed, a temperature, or a humidity level, based on information onthe location of the specific body part detected by the image processingunit.

The location of the specific body part may be a location of a face ofthe person.

The location of the specific body part may be one of a location of ahand of the person and a location of a leg of the person.

The image processing unit may be configured to detect, as a location ofa face of the person, one or more pixels indicating a predeterminedtemperature among the plurality of pixels included in the thermal image.

The image processing unit may be configured to detect, as a location ofa body of the person, an area corresponding to a collection of apredetermined number of pixels or more that vary in temperature within aset period of time, detect a posture of the body of the person from ashape or distribution of the area detected as the location of the bodyof the person, and detect, based on information on the posture detected,a portion of the region detected as the location of the body of theperson, as a location of a hand of the person or a location of a leg ofthe person.

The image processing unit may be configured to determine a behavior ofthe person based on whether a pixel detected as the location of thespecific part moves within a predetermined period of time, and thedevice control unit may be configured to control one or more of the airflow direction, the fan speed, the temperature, and the humidity level,based on the behavior of the person.

The air conditioner may further include a sensor height and angleadjusting unit configured to adjust a height or angle of the thermalimage sensor.

The air conditioner may further include a communication unit configuredto transmit, to a server over a network, data on the thermal imageobtained from the thermal image sensor or data detected by the imageprocessing unit.

These general and specific aspects may be implemented using a system, amethod, an integrated circuit, a computer program, or acomputer-readable recording medium such as a CD-ROM, or any combinationof systems, methods, integrated circuits, computer programs, orcomputer-readable recording media.

Hereinafter, embodiments are specifically described with reference tothe Drawings.

Each of the exemplary embodiments described below shows a general orspecific example. The numerical values, shapes, materials, structuralelements, the arrangement and connection of the structural elements,steps, the processing order of the steps etc. shown in the followingexemplary embodiments are mere examples, and therefore do not limit thescope of the appended Claims and their equivalents. Therefore, among thestructural elements in the following exemplary embodiments, structuralelements not recited in any one of the independent claims defining themost generic part of the inventive concept are described as arbitrarystructural elements.

Note that the Drawings are schematic drawings, and are not necessarilyexact depictions. Moreover, elements having the same essentialconfiguration share the same reference numerals in the Drawings, andduplicate descriptions regarding these elements may be omitted orshortened in the Description.

Embodiment 1 Underlying Knowledge Forming Basis of Embodiment 1

First, the underlying knowledge forming the basis of the air conditioneraccording to Embodiment 1 will be described.

The air conditioner disclosed in PTL 1 includes a human detection devicethat estimates the general location of a person's face or legs from anobtained thermal image.

PTL 2 is poorly conceived as it does not disclose a specific method forestimating the location of a person's face or feet. Moreover, the airconditioner disclosed in PTL 2 does not take into account the state oractivity state of the user.

In other words, air conditioning optimized in accordance with the stateof the user, such as according to whether the user is moving, still inone place, or sleeping, cannot be provided by the air conditionerdisclosed in PTL 2. Moreover, PTL 2 discloses a method for obtaininghigh-resolution, two-dimensional thermal image data, but does notdisclose what kind of controlling the obtained data is used for.

The air conditioner described in Embodiment 1 is an air conditionerwhich includes a thermal image sensor and provides optimal control inaccordance with the state of the user.

[Configuration]

Hereinafter, the air conditioner according to Embodiment 1 will bedescribed. FIG. 1 is an external view of an air conditioner including athermal image sensor.

The air conditioner 10 illustrated in FIG. 1 is configured of asubstantially box-shaped main body 14 that includes an air inlet 11through which air from the room is drawn in, an air outlet 12 throughwhich conditioned air is forced out, and a thermal image sensor 13 thatobtains thermal image data.

First, the air conditioner 10 will be described.

The air drawn into the main body 14 through the air inlet 11 is eitherheated by a heating device (not shown in the Drawings) or cooled by acooling device (not shown in the Drawings) inside the main body 14, andthen returned to the room through the air outlet 12.

In order to draw in air from and reintroduce the air back into the room,a blowing device (not shown in the Drawings) such as a fan is typicallyincluded in the main body 14. This makes it possible to heat or cool alarge amount of air in a short amount of time.

Heat dissipation plates (not shown in the Drawings) such as fins aretypically included in the main body 14, making it possible to moreefficiently heat or cool the air.

The air conditioner 10 also includes a compressor or Peltier type heatexchanger (not shown in the Drawings) for heating or cooling the heatdissipation plates. Note that the heat exchanger may be installedoutside of the room. Installing the heat exchanger outside of the roomreduces the size of the devices of the air conditioner 10 installed inthe room. Furthermore, when cooling the air in the room, since heat fromthe heat exchanger itself is not dissipated into the room, the air inthe room can be efficiently cooled. Moreover, in this case, the heatexchanger and the heat dissipation plates may be connected with a heatpipe or coolant pipe, which have low heat resistance. This increases theefficiency of the heating or cooling of the air.

Next, the thermal image sensor 13 will be described. Either one of athermal image sensor 20 and a thermal image sensor 30, which will bedescribed later, may be used as the thermal image sensor 13 in the airconditioner 10.

FIG. 2 illustrates the thermal image sensor 20, which is one example ofthe thermal image sensor 13. As illustrated in FIG. 2, the thermal imagesensor 20 includes a two-dimensional photosensor 21 configured ofinfrared sensor elements arranged in a matrix, and a lens 22.

For example, a contactless radiation thermometer, such as a thermopilewhich uses thermoelectric power for measurement, a bolometer which usestemperature-dependent electrical resistance for measurement, or apyroelectric sensor which uses the pyroelectric effect for measurement,may be used as the two-dimensional photosensor 21. The two-dimensionalphotosensor 21 of the thermal image sensor 20 includes a total of 512infrared sensor elements (hereinafter simply referred to as photosensorelements) arranged in a matrix of 16 columns and 32 rows.

Moreover, a lens made of a silicon or ZnS, which have a high rate oftransmittance with respect to infrared light, is used as the lens 22.The lens 22 is designed such that infrared light incident on the lens 22at different angles is incident on different photosensor elements.

Next, the room temperature distribution measurement method used by thethermal image sensor 20 will be described. FIG.

3 is a schematic view of a room (observation area) which is the targetof the thermal image sensor 20. FIG. 4 illustrates the temperaturedistribution measurement method employed by the thermal image sensor 20.

For example, when the air conditioner 10 is installed in a room occupiedby a user 41 and a user 42, as illustrated in FIG. 3, the infrared lightradiated from observation pixels 51 is incident on the photosensorelements of the two-dimensional photosensor 21, as illustrated in FIG.4. Note that the observation pixels 51 refer to areas of the room fromwhich the infrared light incident on the photosensor elements isradiated.

A higher temperature of matter in one of the observation pixels 51corresponds to a greater amount of infrared light radiated, and agreater amount of infrared light that is incident on the correspondingphotosensor element. In other words, the temperature distribution of thearea around the air conditioner 10 is computed from the amount ofinfrared light incident on the photosensor elements of thetwo-dimensional photosensor 21.

Since the photosensor elements of the two-dimensional photosensor 21 arearranged in a matrix, the temperature (thermal image data) in eachobservation pixel 51 in the entire observation area 50 is measuredsimultaneously (one frame per sampling interval) throughout thetwo-dimensional photosensor 21. Here, since 512 (16×32) photosensorelements are arranged in the matrix, the entire observation area 50 isdivided into a total of 512 observation pixels 51 in 16 rows and 32columns. Note that the frequency at which the thermal image data isobtained is not limited to one frame per sampling interval. The thermalimage data may be obtained at a rate specified by the user.

Next, a different example of the thermal image sensor 13 will bedescribed. FIG. 5 illustrates the thermal image sensor 30, which is adifferent example of the thermal image sensor 13. As illustrated in FIG.5, the thermal image sensor 30 includes a rotator 31, a one-dimensionalphotosensor 32 configured of linearly arranged photosensor elements, anda lens 33.

Examples of the rotator 31 include a stepper motor and a servo motor.Note that the thermal image sensor 30 is not required to include therotator 31; so long as a scanning system (scanning device) that changesthe orientation of the photosensor elements is used, other drivingstructures are not required. The rotator 31 is more suitable for compactapplications than other driving structures.

For example, similar to the two-dimensional photosensor 21, acontactless radiation thermometer, such as a thermopile which usesthermoelectric power for measurement, a bolometer which usestemperature-dependent electrical resistance for measurement, or apyroelectric sensor which uses the pyroelectric effect for measurement,may be used as the one-dimensional photosensor 32. Moreover, with theone-dimensional photosensor 32, a total of 16 photosensor elements arearranged in one line.

A lens made of a silicon or ZnS, which have a high rate of transmittancewith respect to infrared light, is used as the lens 33, similar to thelens 22.

Next, the room temperature distribution measurement method used by thethermal image sensor 30 will be described. FIG. 6 illustrates thetemperature distribution measurement method employed by the thermalimage sensor 30.

Since the thermal image sensor 30 uses the one-dimensional photosensor32, the observation pixels 51 in linear observation area 61 illustratedin FIG. 6 measure temperature at one time. However, using the rotator31, the linear observation area 61 is moved in a direction (hereinafteralso referred to as the scanning direction or X axis direction)perpendicular to the line axis direction (Y axis direction in FIG. 6),whereby thermal image data for the entire observation area 50 around theair conditioner 10 is obtained, similar to the thermal image sensor 20.For example, by using the rotator 31 to rotate the 1×16 one-dimensionalphotosensor 32 in 32 steps, an arbitrary angle per step, a total of 512(16×32) pixels—that is to say, the thermal image data for the entireobservation area 50—is obtained. If the one-dimensional photosensor 32is rotated five degrees per step, the width of the entire observationarea 50 in the X axis direction is equivalent to 160 degrees.

With the thermal image sensor 30, the temperature in each observationpixel 51 is measured while the rotator 31 rotates the one-dimensionalphotosensor 32. Therefore, the time it takes (frame interval) to obtainthe thermal image data for the entire observation area 50 with thethermal image sensor 30 is longer than the time it takes to obtain thethermal image data for the entire observation area 50 with theabove-described thermal image sensor 20.

Note that with the thermal image sensor 30, the photosensor elements arelinearly aligned in the Y axis direction and moved (rotated) in the Xaxis direction, but the photosensor elements may be linearly aligned inthe X axis direction and moved (rotated) in the Y axis direction.

Moreover, photodiodes are desirably used for the two-dimensionalphotosensor 21 and the one-dimensional photosensor 32. Using photodiodesmakes it possible to obtain the thermal image data at high speeds.

Regardless of whether photodiodes are used or not used for thetwo-dimensional photosensor 21 and the one-dimensional photosensor 32, asystem (heating device) for heating the photosensor is desirablyprovided. Providing a system for heating the photosensor makes itpossible to increase the signal-to-noise ratio of the thermal imagedata. A heating device or Peltier device is used as the heater.

When both the heating device is provided and photodiodes are used forthe photosensor, indium antimonide photodiodes are desirably used. Thismakes it possible to detect the concentration of substances in the air(CO2, CO, H2O) in addition to obtain the thermal image data.Consequently, it is possible to detect a high concentration of CO2 andCO in the air with the thermal image sensor 13 and prompt the user toventilate the room. In this case, the air conditioner 10 desirablyincludes an audio notification system (notification device) to promptthe user to ventilate the room.

Moreover, the air conditioner 10 desirably includes a ventilation devicethat replaces the air in the room. This makes it possible toautomatically (rather than forcing the user to open a window) ventilatethe room when the concentration of CO2 or CO in the air is high.Specifically, the ventilation device is a ventilation window that can beopened and closed by the air conditioner 10, and this ventilation deviceis desirably provided with a filter. This makes it possible to reducethe introduction of, for example, pollen into the room when ventilatingthe room.

Moreover, two-dimensional scanning is desirably performed using aplurality of rotators in the thermal image sensor 13. The rotators mayrotate the thermal image sensor in, for example, pan and tilt (roll)directions. With this, a low-cost, high-performance thermal image sensoris possible.

Next, the system configuration of the air conditioner 10 including thethermal image sensor 13 will be described. FIG. 7 is a block diagramillustrating the system configuration of the air conditioner 10.

As illustrated in FIG. 7, in addition to the thermal image sensor 13,the air conditioner 10 includes a frame memory 15, a computationprocessor 16, an environmental monitoring device 17, a heat exchanger 18a, a blower 18 b, and an air flow direction adjuster 18 c. Thecomputation processor 16 includes an image processor 16 a and a devicecontroller 16 b. Note that the above configuration is not a compulsoryconfiguration of the air conditioner 10; one or more components may beomitted.

Hereinafter, the flow of processes performed by each component in theair conditioner 10 will be described.

First, the thermal image sensor 13 obtains electric signals(thermoelectric power in the case of a thermopile) from the photosensorelements, and generates two-dimensional thermal image data based on theobtained electric signals. This concludes the description of the thermalimage sensor 13.

The generated two-dimensional thermal image data is stored in the framememory 15. The frame memory 15 is not limited to any specific kind ofmemory, and may be any structure that has general storage functions,such as a semiconductor memory. Moreover, the frame memory 15 may beprovided internally in the air conditioner 10 or externally connected tothe air conditioner 10.

The computation processor 16 obtains and performs computing on thetwo-dimensional thermal image data stored in the frame memory 15. Thecomputation processor 16 is not limited to any specific kind ofprocessor, and may be any structure that has a computing function, suchas a microcomputer.

Firstly, the image processor 16 a in the computation processor 16performs image processing by detecting, for example, a location of aperson in the thermal image data, the amount of clothes the person iswearing in the thermal image data, or the temperature distribution ofthe room in the thermal image data, based on the thermal image datastored in the frame memory 15. A specific example of the imageprocessing algorithm used in the image processor 16 a will be describedlater. The image processor 16 a then outputs information, such as thelocation of the user, the temperature of the hands or face of the user,or the temperature of a wall, to the device controller 16 b.

Based on the information outputted by the image processor 16 a, thedevice controller 16 b computes control information for controlling(temperature control, fan speed control, and air flow direction control)the heat exchanger 18 a, which is, for example, a compressor, the blower18 b, which is, for example, a fan, and the air flow direction adjuster18 c, which is, for example, louvers. The control information computedby the device controller 16 b is, for example, a number of times ofrotation in the case of the blower 18 b, or an angle of the louvers inthe case of the air flow direction adjuster 18 c. Note that the devicesto be controlled by the device controller 16 b are not limited to theheat exchanger 18 a, the blower 18 b, and the air flow directionadjuster 18 c.

Note that, as illustrated in FIG. 7, the air conditioner 10 includes theenvironmental monitoring device 17 which may monitor the temperature andhumidity of the room, and based on the temperature and humidity, forexample, may control the temperature of the room and the fan speed.

Furthermore, the environmental information, such as the room temperatureand humidity, obtained by the environmental monitoring device 17 isdesirably transmitted to the image processor 16 a. The reason for thiswill be described later.

Moreover, in addition to the room temperature and humidity, theenvironmental information desirably includes outside temperature,illuminance inside and outside the room, and radiant heat outside theroom. The reason for this will be described later.

Note that the image processor 16 a may be provided external to the airconditioner 10. FIG. 8 is a block diagram illustrating the systemconfiguration of an air conditioner including an external imageprocessor.

As illustrated in FIG. 8, an air conditioner 10 a includes acommunication device 19. Thermal image data is transmitted to a server80 via the communication device 19. With this configuration, an imageprocessor 81 in the server 80 computes, for example, the location of theuser, the state of the user (user's hand or face temperature, amount ofclothes, posture, etc.), and the temperature of a wall.

With this configuration, since thermal image data is regularlytransmitted to the server 80 via the communication device 19, it ispossible to check the sensitivity degradation of the thermal imagesensor, and adjust the sensor sensitivity. Here, transmission by thecommunication device 19 is conducted via Wi-Fi (registered trademark) orBluetooth (registered trademark), and the communication device 19 maytransmit the thermal image data to a server 80 located outside of theroom over a network such as the internet. The data transmitted by thecommunication device 19 is not limited to thermal image data, and may bea sensor output from the thermal image sensor 13.

It is desirable that the environmental information also be transmittedto the server 80 via the communication device 19 for reasons to bedescribed later.

[Detection of User Location]

Next, the method used by the image processor 16 a to detect the locationof the user based on the thermal image data and measure the temperatureof parts of the user's body, such as the user's face and hands, in orderto assess the state of the user, will be described along with theadvantageous effects of the method. Note that in the followingdescription, either one of the thermal image sensor 20 and the thermalimage sensor 30 may be used as the thermal image sensor 13.

First, the method for measuring the temperature of the user's face willbe described.

One example of a simple method for detecting the location of the userand measuring the temperature of the user's face includes detectingobservation pixels 51 between 30 degrees Celsius and 40 degrees Celsiusin the thermal image data for each frame, and determining the locationof the detected observation pixels 51 to be the location of the user'sface, and determining the temperature of the detected observation pixels51 to be the temperature of the user's face.

Moreover, the location of observation pixels 51 having a temperature of30 degrees Celsius to 40 degrees Celsius and a change in temperature ofone or more degrees Celsius from the previous frame may be determined tobe the location of the user's face. Since heat-generating objects otherthan people do not move much between frames and change little intemperature between frames, this kind of configuration makes it possibleto more accurately detect the location of the user.

With this sort of detection of user location, the air conditioner 10can, for example, help prevent drying out the user's skin by avoidingblowing air directly at the user (control of the air flow directionadjuster 18 c by the device controller 16 b).

Moreover, by measuring the temperature of the user's face as describedabove, it is also possible to reduce the danger of the user sufferingfrom heat exhaustion. For example, when the temperature of the user'sface is 37 degrees Celsius or more, it is possible to increase theintensity of the cooling to reduce the danger of the user suffering fromheat exhaustion. Moreover, if the temperature of the user's face is 37degrees Celsius or more on a steady basis, the air conditioner 10 candetermine that the user has a cold or influenza and increase thehumidity.

Even if the heat exchanger 18 a and the device controller 16 b are notbeing driven, the temperature of the user's face can be measured by thethermal image sensor 13. In other words, even when the air conditioner10 itself is not being operated (is turned off), the thermal imagesensor 13 can continue to monitor. With this, when, for example, thedevice controller 16 b and the heat exchanger 18 a are turned off andthe user is sleeping, it is possible to both reduce power consumptionand prevent heat exhaustion.

Note that the size of each observation pixel 51 is desirably 20 cm×20 cmor smaller. This makes it possible to more accurately measure thetemperature of the user's face, thereby making it possible to moreaccurately prevent heat exhaustion. Although different models aredesigned for rooms of different dimensions, with the air conditioner 10,the size of each observation pixel 51 is desirably 20 cm×20 cm orsmaller in a location 3.6 m away for an air conditioner 10 designed fora 6-jo (roughly 10 m²) room, 4.5 m away for an air conditioner 10designed for an 8-jo (roughly 13 m²) room, and 7.2 m away for an airconditioner 10 designed for a 12-jo (roughly 19 m²) room.

Note that by designing the size of each observation pixel 51 to be lessthan 20 cm×20 cm, although the total number of observation pixels 51increases beyond 512, this configuration is advantageous since it allowsfor high-resolution measurement.

Moreover, when an observation pixel 51 corresponding to the location ofthe user's face does not change for a set period of time or longer, theuser may be determined to be sleeping. Here, a “set period of time” is,for example, one minute to 60 minutes. When the air conditioner 10determines that the user is sleeping, it is possible to provide the userwith, for example, a function for reducing noise by reducing the speedof the fan, a function for dimming, for example, LEDs which are on whenthe air conditioner 10 is in operation, and a function for reducingpower consumption by reducing the intensity of the cooling or heating.

Here, reducing the intensity of the cooling and heating can beaccomplished by reducing the number of rotations or rotational speed ofthe compressor. Likewise, increasing the intensity of the cooling andheating can be accomplished by increasing the number of rotations orrotational speed of the compressor.

Moreover, when the location of the user's face changes greatly (forexample, 30 cm or more) while the user is sleeping, the user may bedetermined to have woken up. By recording when the user wakes up basedon separately obtained time information, it is possible to provide theuser with a function for causing the heater to turn on in the winter andcausing the cooler to turn on in the summer around the time the userwakes up.

Additionally, although not shown in the Drawings, the air conditioner 10may include a memory device (memory) separate from the frame memory 15for recording of information such as the time the user wakes up.Moreover, the user may be allowed to choose whether or not certainfunctions provided by the air conditioner 10 will be used or not via auser interface such as remote control. This makes it possible to allowthe user to select functions suited to his or her preferences. Note thatselection of the functions may also be performed over a network using asmart phone or television, for example.

The air conditioner 10 may also include a room lighting function. Thismakes it possible for the air conditioner 10 to provide the user with afunction for causing the lights to turn on around the time the userwakes up. Additionally, when the air conditioner 10 includes thecommunication device 19, the air conditioner 10 may cause a lightingdevice provided external to the air conditioner 10 to turn on via acommunication network.

The temperature of the user's face while sleeping may be regularlystored in a memory separate from the frame memory 15. This makes itpossible to estimate the basal body temperature of the user from thetemperature of the user's face measured before the user wakes up, andprovide daily basal body temperature information to the user.

When the basal body temperature being measured is for a female user, airconditioning control that increases the humidity more than usual may beperformed during the user's menstruation phase, during which the basalbody temperature decreases. This makes it possible to prevent rough skinfrom dryness (particularly effective in times where the skin tends todry out) and provide energy saving air conditioning throughout the year.

In order to achieve the above, the air conditioner 10 desirably includesa humidity controller. The humidity controller is, for example, ahumidity controller which collects moisture from a device outside theroom and disperses the moisture inside the room, but the humiditycontroller may be a humidity controller which disperses, inside theroom, moisture from a water tank provided by the user.

When the user is female, the air conditioner 10 may compute, from thedaily basal body temperature, a temperature at the boundary between ahigh-temperature phase and a low-temperature phase, and determinewhether the user is currently in a high-temperature phase or alow-temperature phase. FIG. 9 is a flow chart for determining thehigh-temperature phase and the low-temperature phase.

As illustrated in FIG. 9, the air conditioner 10 accumulates past dailybasal body temperature information (S11), and computes a boundarytemperature between the high-temperature phase and the low-temperaturephase (S12). The air conditioner 10 then measures the user's basal bodytemperature for the current day (S13).

Moreover, when the user's basal body temperature for the current dayfalls within the high-temperature phase (Yes in S14) and when the user'sbasal body temperature for the current day falls within thelow-temperature phase (No in S14), in either case, the air conditioner10 may determine the user to be during the “ovulation phase”, “lutealphase”, “menstruation phase”, or “follicular phase” (S15 to S20) basedon whether the number of days from the start of the cycle is within sixdays or seven days or more, and provide the user with a recommendationor notification according to the phase.

For example, the user may be notified during her ovulation phase that itis easy to become pregnant in the ovulation phase (S21). The user may berecommended to promote blood circulation by bathing or to stayhumidified during her luteal phase (S22). The luteal phase may bedivided into an early period and a later period, and the user may berecommended to take measures to protect against ultra-violet rays in thelater period.

The user may be recommended to promote blood circulation and stayhumidified by bathing during her menstruation phase (S23). The user maybe notified during her follicular phase that it is easy to lose weightby dieting in the follicular phase, and may be recommended to diet byexercising (S24).

With this configuration, it is easy for a female user to manage herhealth in conjunction with her menstrual cycle.

Note that the female user may be informed of the notifications andrecommendations a few days ahead of time. This makes it possible for thefemale user to make preparations for taking measures to protect againstultra-violet rays in advance and manage her schedule, such as makingappointments at a training gym. Note that the order of the steps, basisfor determination (number of days), notification content, andrecommendation content illustrated in the flow chart in FIG. 9 are justone example.

In the case that basal body temperature information is provided to theuser using a rotating (scanning) thermal image sensor 30, such as thethermal image sensor 30 illustrated in FIG. 5, when the user isdetermined to be sleeping, it is desirable that the frequency at whichthe temperature of the area around the user is measured is increased.This makes it possible to estimate the basal body temperature with ahigher degree of accuracy.

Methods used to increase the frequency at which the temperature of agiven area is measured using a rotating thermal image sensor 30 includesa method of reducing the rotational speed only while the temperature inan observation pixel 51 in the given area is being measured, and amethod of measuring back and forth only the observation pixel 51 forwhich measurement frequency is desired to be increased.

The air conditioner 10 may store the time the user wakes up on a dailybasis, and increase the frequency that the temperature of the user'sface is measured during a time period around the time that the userwakes up. This makes it possible to both reduce power consumption andimprove the measurement accuracy of the basal body temperature.

The location of the entire observation area 50 may be changed based onthe state of the user. FIG. 10A and FIG. 1013 illustrate examples of howthe location of the entire observation area 50 is changed based on thelocation of the user.

Like the entire observation area 91 in FIG. 10A in which the user isawake and the entire observation area 92 in FIG. 10B in which the useris asleep, the air conditioner 10 may include an angle setting changingdevice for the thermal image sensor 13 for changing the location of theentire observation area based on the state of the user.

This makes it possible for the air conditioner 10 to change the locationof the entire observation area and detect the face of the user even whenthe user is sleeping directly below the air conditioner 10 (outside ofthe entire observation area 91). Since it is possible to reduce thenumber of photosensor elements in the thermal image sensor 13 with thissort of configuration, it is possible to realize a low-cost thermalimage sensor 13. Note that the angle setting changing device is, morespecifically, a rotating structure such as a stepper motor or a servomotor.

The location of an observation pixel 51 that both changes in temperaturewithin a predetermined period of time and indicates a temperature of 30degrees Celsius or greater may be recognized as the location of the bodyof the user. Here, a “predetermined period of time” is, for example, oneminute to 60 minutes. When a plurality of the observation pixels 51 thatfulfill this condition are in a series, the air conditioner 10 candetermine that the body of a single user is present in the location ofthese plurality of observation pixels 51.

As another example, the location of an observation pixel 51 thatindicates a temperature of 25 degrees Celsius or greater may berecognized as the location of the body of the user. Moreover, a hightemperature observation pixel 51 that indicates a temperature higherthan a predetermined amount higher than the room temperature and changesin temperature within a predetermined period of time may be recognizedas the location of the body of the user.

Moreover, the posture of the user can be assessed based on thearrangement of the series of observation pixels 51.

The air conditioner 10 can moreover estimate the height of the userbased on the vertical height (length in the Y axis direction) of theseries of observation pixels 51 determined to be the location of thebody the user. With this method, since the vertical height of theobservation pixels 51 equivalent to the body of the user variesdepending on the posture of the user (whether the user is, for example,standing or sitting), accurately estimating the height of the user isdifficult. However, by regularly storing the measurement result of thevertical height of the observation pixels 51 per user, it is possible toestimate the height of the user while standing based on the maximumvertical height of the observation pixels 51.

If user height can be estimated in this way, it is possible todifferentiate the users based on height and provide air conditioning atdifferent settings for different users. For example, when the preferredroom temperature is different for each user, by differentiating betweenusers, the air conditioner 10 can automatically change the temperaturesetting based on the user in the room.

Note that the relationship between the vertical height of theobservation pixels 51 and the height of the user varies depending on thedistance between the user and the thermal image sensor 13 (the airconditioner 10). For this reason, the air conditioner 10 may include asystem which estimates the distance between the user and the thermalimage sensor 13. This makes it possible to estimate the height of theuser with greater accuracy.

A system which measures the distance between the air conditioner 10 andthe floor is used as the system for measuring the distance between theuser and the air conditioner 10. For example, the distance between thefloor may be measured by installing a contactless distance measuringsystem such as a laser focus structure or an ultrasound system on thebottom of the air conditioner 10.

In the air conditioner 10, the direction (angle) of each observationpixel 51 relative to the thermal image sensor 13 is known (determined inadvance). Consequently, the air conditioner 10 can, based on thedistance between the floor and the thermal image sensor 13, compute howfar apart each observation pixel 51 is from the floor directly below theair conditioner 10. In other words, the air conditioner 10 can computethe distance between a user standing on the floor and the airconditioner 10.

In this way, computing the distance between the user and the airconditioner 10 makes it possible to more accurately estimate the heightof the user and more accurately differentiate between users.

The air conditioner 10 may also include a system for setting thedistance between the air conditioner 10 and the floor (such as a remotecontrol setting). Having the height of the installation location of theair conditioner 10 (distance from the floor to the installationlocation) being input by the user or the installer of the airconditioner 10 makes it possible to more accurately measure the heightof the user.

Moreover, the air conditioner 10 may include a system for measuring howtilted the installation angle of the air conditioner 10 is with respectto a direction perpendicular to the floor (that is, a verticaldirection). This makes it possible to more accurately estimate theheight of the user and the distance between the user and the airconditioner 10 even when the air conditioner 10 is installed tilted atan angle, such as when the surface (wall) to which the air conditioner10 is installed is not perpendicular to the floor.

The air conditioner 10 may also include a lighting system thatilluminates the observation area of the thermal image sensor 13, andthis system may be adjacent to the lighting device. Illuminating theentire observation area 50 of the thermal image sensor 13 makes itpossible for the user to easily confirm the area where the temperatureis being measured (which is the area illuminated).

Therefore, the lighting system is desirably a dedicated system thatshines light only on the entire observation area 50 of the thermal imagesensor 13. This sort of lighting system makes it possible for the userto accurately assess the location of the entire observation area 50.

Moreover, the thermal image sensor 13 may include a far-infraredirradiation system, and alternatively may be adjacent to thefar-infrared irradiation system. In this case, it is desirable that theoptical system of the thermal image sensor 13 be designed such that thefurther a target object to which far-infrared light is radiated is fromthe far-infrared irradiation system, the lower the density of thefar-infrared light received as a result of the radiation is.

The air conditioner 10 having such a configuration can assess thedistance between each area in the observation area and the thermal imagesensor 13 by comparing thermal image data from the thermal image sensor13 when far-infrared light is radiated toward the observation area withthermal image data from the thermal image sensor 13 when far-infraredlight is not radiated. This is because the greater the amount ofvariation between the radiation thermal image data and the non-radiationthermal image data for an observation pixel 51, the closer an object inthe observation pixel 51 is to the thermal image sensor 13. Accordingly,the air conditioner 10 can recognize an obstruction that blocks the flowof air in the room (such as a dresser placed next to the air conditioner10), and control the flow of air such that the air flows around theobstruction to the user. By, for example, changing the direction of theair flow to a direction in which the obstruction is not located,efficient air conditioning can be provided and low power consumption canbe achieved.

Moreover, by assessing the posture of the user as described above, theair conditioner 10 can detect an observation pixel 51 that correspondsto a hand or leg of the user. In other words, the air conditioner 10 canmeasure the temperature of an observation pixel 51 corresponding to ahand or leg of the user.

Based on research carried out by the inventors, it is known that,although the temperature of a user's hand when the user feels mostcomfortable varies from person to person, the majority of people feelmost comfortable when the temperature of their hands is around 30degrees Celsius. Consequently, as a result of the air conditioner 10measuring the temperature of a user's hand and performing automaticcontrol such that the temperature of the user's hand becomesapproximately 30 degrees Celsius, it is possible to spare the user thetrouble of adjusting the room temperature.

Moreover, for users who cannot operate the air conditioner themselves,such as users who are sleeping or users who are children, this sort ofautomatic control is effective in preventing excessive heating orcooling, and thus effective from an energy saving perspective as well.

Conceivable examples of this automatic control include, for example,when the user is using the cooling function of the air conditioner 10during the summer, reducing the intensity of the cooling when thetemperature of the user's hand is less than 30 degrees Celsius andincreasing the intensity of the cooling when the temperature of theuser's hand is 30 degrees Celsius or greater. Note that increasing themovement of heat between inside and outside the room with the heatexchanger 18 a increases the intensity of the cooling and reducing themovement reduces the intensity of the cooling. When the heat exchanger18 a is a compressor, increasing the number of rotations increases theintensity of the cooling and reducing the number of rotations reducesthe intensity of the cooling. Moreover, the same holds true for theheater during the winter.

By controlling the heat exchanger 18 a by estimating the user's thermalsensation based on the temperature of the user's hand, it is possible toreduce instances where the heater is being used despite the temperatureof the user's hand being 30 degrees Celsius or greater, as well asinstances where the cooler is being used despite the temperature of theuser's hand being 30 degrees Celsius or less. In other words, it ispossible to save energy.

Note that the longer a user is in a high-temperature, high-humidityenvironment, the greater the temperature of his or her hand will be,making the user feel hot. Dehumidification may therefore be performedinstead of increasing the intensity of the cooling in theabove-described automatic control.

The air conditioner 10 includes the heat exchanger 18 a, but an airconditioner that includes a heat-generating system (heat-generatingdevice) such as an electric or kerosene heater, or an air conditionerthat includes a humidifying and dehumidifying function instead of aheating and cooling function is also capable of performing similarcontrol.

For example, when the temperature of the user's hand is high, in thecase of heating, the intensity of the heating may be reduced by reducingthe driving power of the heat exchanger 18 a, and in the case ofcooling, the intensity of the cooling may be increased by increasing thedriving power of the heat exchanger 18 a. Moreover, when the temperatureof the user's hand is high, using the heat-generating system, theintensity of the heating may be reduced, the intensity of thehumidification may be reduced, or the intensity of the dehumidificationmay be increased. This is because the hotter or more humid the user is,the hotter the user's hand is, and the cooler or less humid the user is,the cooler the user's hand is.

Moreover, automatic control just like with the temperature of the handmay be performed based on temperature measurement of the user's leg.

Moreover, similar automatic control may be performed by measuring thetemperature of a part of the user other than his or her arm or leg, butthe user's limbs, in particular the user's hands and feet, are suitableas a reference for measuring the level of comfort of the user. Throughresearch, the inventors have found that, as a reference for the user'sthermal sensation and the user's level of comfort, the user is sensitiveto the temperature of his or her limbs compared to other parts of thebody. Thus, highly accurate temperature control can be achieved usingthe temperature of the user's limbs as a reference.

[User Interface]

Hereinafter the user interface of the above-described air conditioner 10will be described. FIG. 11A, FIG. 11B, and FIG. 11C illustrate examplesof the user interface of the air conditioner 10.

As an example of the user interface, FIG. 11A, FIG. 11B, and FIG. 11Cillustrate a remote control 70 including a display device 74 having aninput function such as a touch panel. Note that the type of userinterface is not limited to this example; the input device (settingreceiver) and the display device 74 may be separate. Moreover, the userinterface of the air conditioner 10 is not limited to this sort ofdedicated remote control. A smart phone or tablet with an applicationinstalled may be used as the remote control 70 for the air conditioner10.

The user interface of the air conditioner 10 has the followingcharacteristics.

With conventional air conditioners, the user typically uses a remotecontrol to set the room temperature, fan speed, and air flow direction.Conversely, with the air conditioner 10, the user can set a target handtemperature or a target leg temperature, as illustrated in FIG. 11A.This makes it possible, for example, for the user to set a desired handtemperature (leg temperature) as a target temperature.

With the user interface illustrated in FIG. 11A, specific targettemperatures are set for hand and leg temperatures, but selections(icons) such as “hot”, “medium”, and “cool” may be displayed on the userinterface. When these icons are displayed, the amount of text displayedon the user interface is reduced, making it possible to increasereadability by increasing the size of the icons displayed. Moreover,user's who are unsure of their ideal hand temperature can more easilyselect an air conditioning control based on their hand temperature. Notethat “hot”, “medium”, and “cool” are equivalent to user handtemperatures of 31 degrees Celsius, 30 degrees Celsius, and 29 degreesCelsius, respectively.

The air conditioner 10 may have a configuration in which a mode forcontrolling the air conditioner 10 based on hand temperature (handtemperature control mode) and a mode for controlling the air conditioner10 based on leg temperature (leg temperature control mode) areselectable. In this case, for example, the user selects a mode via theuser interface.

For example, in FIG. 11A, the target hand temperature is enclosed with abold line; this is to indicate that the user has selected the handtemperature control mode.

For example, the user can change the mode depending on the state of theuser (for example, what clothes the user is wearing), such as select theleg temperature control mode when barefoot, or select the handtemperature control mode when wearing slippers. This makes it possiblefor the air conditioner 10 to more accurately estimate the thermalcomfort of the user and provide air conditioning accordingly.

Moreover, a thermal image (icon of a silhouette of a person in FIG. 11B)visually indicating the current body temperature of the user may bedisplayed on the user interface, as illustrated in FIG. 11B. In FIG.11B, the color of the icon is dependent on the temperature of the user(in FIG. 11B the color is illustrated in shading; the darker shadedportions indicate a hotter region). For example, high temperatureregions are displayed in red, and low temperature regions are displayedin blue.

This makes it possible for the user to know his or her current bodytemperature at a glance. This in turn makes it possible for the user toeasily estimate a target hand temperature or target leg temperaturesetting.

Note that the user interface may be configured such that the user canchange the target room temperature, target hand temperature, and targetleg temperature directly from the screen displayed in FIG. 11B. Forexample, a configuration where the target room temperature, target handtemperature, and target leg temperature can be changed by the usertouching, or performing an input action such as tracing, a region on theuser interface corresponding to a region the user desires to increasethe temperature of, is conceivable.

Hereinafter, the system configuration of the remote control 70 (userinterface) will be described. FIG. 11D is a block diagram illustratingthe system configuration of the remote control 70.

As illustrated in FIG. 11D, the remote control 70 includes a firstsetting-receiver 71, a second setting-receiver 72, a thirdsetting-receiver 73, a display device 74, a remote-control controller 75(controller), and a remote control communication device 76(communication device).

The remote control 70 is a user interface for the air conditioner 10,which includes a thermal image sensor 13 for generating a thermal imageshowing a temperature distribution of a target area (for example, insidea room).

The first setting-receiver 71 receives a target temperature setting fora room. More specifically, the first setting-receiver 71 is a touchpanel (the region illustrated in FIG. 11A for setting the target roomtemperature) layered with the display device 74, but the firstsetting-receiver 71 may be a mechanical button.

The second setting-receiver 72 receives a target temperature setting fora certain part of the target area. The second setting-receiver 72receives, as the target temperature for the certain part, a targettemperature setting for at least one of the location of the person'sface, the location of the person's hand, or the location of the person'sleg. More specifically, the second setting-receiver 72 is a touch panel(the region illustrated in FIG. 11A for setting the target legtemperature and the target hand temperature), but the secondsetting-receiver 72 may be a mechanical button.

The third setting-receiver 73 receives an air flow direction setting anda fan speed setting for the air conditioner 10. More specifically, thethird setting-receiver 73 is a touch panel (the region illustrated inFIG. 11A for setting the air flow direction and fan speed levelsettings), but the second setting-receiver 72 may be a mechanicalbutton.

As will be described later, when the setting for the target temperatureis set for the first setting-receiver 71 and the setting for the targettemperature is set for the second setting-receiver 72, the thirdsetting-receiver refrains from receiving the setting for the air flowdirection and the setting for the fan speed. Here, “does not receive asetting” more specifically means, for example, an input received by thethird setting-receiver 73 is not recognized as a valid input by theremote-control controller 75, or the remote-control controller 75 doesnot transmit an input received by the third setting-receiver 73 to theair conditioner 10 as a command.

The display device 74 displays images such as those illustrated in FIG.11A through FIG. 11C. The display device 74 displays the target roomtemperature, the target leg temperature, the target hand temperature,the air flow direction, and the fan speed. The display device 74 is,more specifically, a liquid crystal panel or an organicelectroluminescent (EL) display.

The display device 74 moreover displays the temperature at the locationof a person detected based on the thermal image data. Here, the locationof a person includes at least one of the location of a person's face,the location of a person's hand, or the location of a person's leg. Morespecifically, the display device 74 displays the body temperature of aperson with a colorful person-shaped icon, such as the one illustratedin FIG. 11B, but the display device 74 may display temperature asnumbers.

As will be described later, when target temperatures are set for each ofthe first setting-receiver 71 and the second setting-receiver 72, thedisplay device 74 displays that input of a setting to the thirdsetting-receiver 73 is not possible. More specifically, the displaydevice 74 displays the area for the air flow direction and the fan speedas faded (grayed), as illustrated in FIG. 11C.

The remote-control controller 75 transmits commands corresponding to thesettings received by the first setting-receiver 71, the secondsetting-receiver 72, and the third setting-receiver 73 to the airconditioner 10 via the remote control communication device 76. Moreover,based on thermal image data (information on the thermal image) receivedby the remote control communication device 76, an icon of a personindicating body temperature like the one illustrated in FIG. 11B isdisplayed on the display device 74.

The remote control communication device 76 is a communication module forthe remote-control controller 75 to transmit commands to the airconditioner 10. The remote control communication device 76 receivesthermal image data from the air conditioner 10 (the thermal image sensor13). The remote control communication device 76 is a wirelesscommunication module that employs infrared light technology. Note thatthe air conditioner 10 includes a communication device for communicationwith the remote control communication device 76.

[User Level of Comfort]

The user's level of comfort is affected by not only his or her bodysurface temperature, but his or her core temperature as well.Temperature may therefore be measured from at least two locations:temperature of a portion of the body which closely indicates coretemperature (face, neck, etc.) and temperature of an extremity (hand,leg, etc.), such as “face temperature and hand temperature” or “necktemperature and leg temperature”. This allows for more accurateestimation of the level of comfort of the user, and more accurate airconditioning based on the estimation.

The air conditioner 10 (the image processor 16 a) may determine whetherthe user is wearing glasses, a mask, gloves, socks, or slippers, etc.,based on the thermal image data. The air conditioner 10 may include asystem which notifies the user of a decrease in temperature measurementaccuracy based on the user wearing, for example, glasses, a mask,gloves, socks, or slippers, etc., based on the above detection result.For example, an alarm is displayed on the user interface illustrated inFIG. 11A and FIG. 11B to notify the user of this.

This makes it possible to make the user aware that the temperaturemeasurement is inaccurate, which allows the user to eliminate the sourceof the inaccurate measurement or switch to a different mode which uses adifferent reference that yields an accurate measurement.

For example, when the user is wearing gloves, by displaying “inaccuratehand temperature measurement due to gloves” on the user interface, theuser can switch to the leg temperature control mode, or remove his orher gloves, for example. This increases the temperature measurementaccuracy of the air conditioner 10.

Moreover, at this time, other than notification by display of text, theuser may be notified by audio by a notification system. This makes itpossible to notify the user in real time. Moreover, using bothnotification systems of audio and text display makes it possible toincrease the notification accuracy to the user when the user is in aloud environment or listening to music.

Note that the following method can be used to determine whether the useris wearing an article such as a mask or not. It is possible to determinewhether the user is wearing a mask or not from the temperaturedifference between the temperature of an observation pixel 51corresponding to the user's eye and the temperature of an observationpixel 51 corresponding to the user's mouth. When the user is wearing amask, the temperature of an observation pixel 51 corresponding to theuser's mouth is greater than when the user is not wearing a mask. It ispossible to determine whether the user is wearing glasses or not withthe same method since the temperature of an observation pixel 51corresponding to an eye decreases. Moreover, it is possible to determinewhether the user is wearing gloves or not by comparing the temperatureof an observation pixel 51 corresponding to the palm of the user's handwith the temperature of an observation pixel 51 corresponding to theuser's upper arm, and possible to determine whether the user is wearingsocks or slippers by comparing the temperature of an observation pixel51 corresponding to the user's foot with the temperature of anobservation pixel 51 corresponding to the user's calf.

When it is the thermal image sensor 13 that determines whether the useris wearing glasses, a mask, gloves, socks, or slippers, etc., the sizeof each observation pixel 51 is desirably 10 cm×10 cm or smaller.Setting the size of each observation pixel 51 to be 10 cm×10 cm orsmaller makes it possible to more accurately determine whether the useris wearing a certain article or not. Although different models aredesigned for rooms of different dimensions, with the air conditioner 10,the size of each observation pixel 51 is desirably 10 cm×10 cm orsmaller in a location 3.6 m away for an air conditioner 10 designed fora 6-jo (roughly 10 m²) room, 4.5 m away for an air conditioner 10designed for an 8-jo (roughly 13 m²) room, and 7.2 m away for an airconditioner 10 designed for a 12-jo (roughly 19 m²) room. Additionally,in accordance with setting the size of each observation pixel 51smaller, it is desirable that the total number of observation pixels 51be greater than 512.

The air conditioner 10 may measure the temperature of the outermostarticle of clothing the user is wearing based on the thermal image data.With this, the thermal insulation properties of the clothes (the amountof clothes) the user is wearing can be estimated as one state of theuser. The clothes the user is wearing can be determined to have highthermal insulation properties for lower temperatures of the outermostarticle of clothing, and when the thermal insulation property isdetermined to be high, it is possible to increase the intensity of thecooling (reduce the intensity of the heating). Since the relationbetween the user's thermal sensation and the temperature of his or herhand or leg changes depending on the amount of clothes the user iswearing, air conditioning suited to the user's thermal sensation isprovided by estimating the amount of clothes the user is wearing andcorrecting the air conditioning temperature set based on the amount ofclothes.

Moreover, the relationship between the user's thermal sensation and thetemperature of his or her limbs is affected by radiant heat from theroom. The air conditioner 10 therefore desirably includes a system formeasuring the distribution of the temperature in the room. This allowsfor air conditioning that is suited to the user's thermal sensation andperformed according to the radiation of heat from the room. Note thatthe measurement of the temperature distribution of the room is performedby, for example, the thermal image sensor 13.

The relationship between the user's thermal sensation and thetemperature of his or her limbs is also affected by humidity. The airconditioner 10 therefore desirably includes a system for measuring thehumidity in the room. This allows for air conditioning that is suited tothe user's thermal sensation and performed according to the humidity inthe room. Note that the measurement of the humidity is performed by, forexample, a common hygrometer.

The relationship between the user's thermal sensation and thetemperature of his or her limbs is also affected by the user's amount ofexercise, amount of activity, and posture. The air conditioner 10therefore desirably includes a system for measuring the user's amount ofexercise, amount of activity, and posture. This allows for airconditioning that is suited to the user's thermal sensation andperformed according to the user's amount of exercise, amount ofactivity, and posture. Note that the user's amount of exercise, amountof activity, and posture is computed from, for example, an imagecaptured by the thermal image sensor 13.

The relationship between the user's thermal sensation and thetemperature of his or her limbs is also affected by the user's circadianrhythm. The air conditioner 10 therefore desirably includes a system formeasuring the current time (a clock). This allows for air conditioningthat is suited to the user's thermal sensation and takes into accountthe influence of the circadian rhythm.

The relationship between the user's thermal sensation and thetemperature of his or her limbs is also affected by the user's behavior,such as the user's eating or bathing routine. The air conditioner 10therefore desirably includes a system for assessing the user's behavior,such as the user's eating or bathing routine. This allows for airconditioning that is suited to the user's thermal sensation andperformed according to the user's behavior. For example, whether theuser is eating or not can be deduced by detecting a heat source on topof the dining table. Moreover, the air conditioner 10 may determine thata user is eating based on the amount of time the user remains around thedining table, or the number of users around the dining table. Moreover,it is possible to determine whether a user is bathing or not based oninformation on the body temperature of the user. The thermal imagesensor 13 is therefore used to determine both whether the user is eatingor not and whether the user is bathing or not.

The relationship between the user's thermal sensation and thetemperature of his or her limbs is also affected by the season. The airconditioner 10 therefore desirably includes a system for measuring thedate and time and the outside temperature. This allows for airconditioning that is suited to the user's thermal sensation andperformed according the season.

The relationship between the user's thermal sensation and thetemperature of his or her limbs is also affected by the user'sperspiration. The air conditioner 10 therefore desirably includes asystem for measuring the amount of perspiration produced by the user.This allows for air conditioning that is suited to the user's thermalsensation and performed according to the measured amount ofperspiration. The system for measuring the user's amount of perspirationis, for example, a wearable sensor or far-infrared range spectroscopicsensor that measures the electrical conductivity of the skin.

Note that the user's amount of perspiration may be estimated as follows.Generally, moisture is easily absorbed in light having a wavelength of 6μm to 7 μm. Therefore, if, for example, the air conditioner 10 includesa system for measuring infrared light having a wavelength of 7 μm orlower and a system for measuring infrared light having a wavelength of 7μm or higher, it is possible to measure a humidity distribution from alight amount ratio of infrared light received by the two measuringsystems. Then, when the humidity in the area around the user is higherthan the humidity of the broader area, it can be estimated that thehumidity will increase from the evaporation of perspiration. In thisway, the air conditioner 10 may estimate the amount of perspiration froma humidity distribution of an area around the user.

Moreover, the air conditioner 10 may perform the same measurement usingnear-infrared wavelengths that cause absorption of water, such as 1.5 μmand 1.9 μm. So long as these spectroscopic methods which employ infraredlight are used, the air conditioner 10 can measure the user's amount ofperspiration with a contactless method. In other words, the airconditioner 10 can measure the amount of perspiration for a user who isnot wearing a wearable sensor.

Moreover, the air conditioner 10 may estimate the amount of perspirationusing spectroscopic technology by measuring the moisture of the user'sskin of body parts not covered by clothes, such as the user's face,neck, hands, and legs.

The air conditioner 10 may measure the temperature of the user's nosebased on the thermal image data. This makes it possible to estimate thestress state of the user.

Embodiment 1 provides an example where the air conditioner 10 estimatesthe user's thermal sensation using the temperature of the user's hand orthe temperature of the user's leg and performs air conditioning controlaccordingly. Here, the air conditioner 10 may measure the temperature ofone or more of the user's cheek, nose, ear, and chin based on thethermal image data. This increases the estimation accuracy of the user'sthermal sensation. This also makes it possible to accurately estimatethe user's thermal sensation even when the user is wearing gloves orslippers.

When the thermal image sensor 13 is used to measure the temperature ofone or more of the user's cheek, nose, ear, and chin, the size of eachobservation pixel 51 is desirably 5 cm×5 cm or smaller. Setting the sizeof each observation pixel 51 to be 5 cm×5 cm or smaller makes itpossible to more accurately measure the temperature of the user's nose.Although different models are designed for rooms of differentdimensions, with the air conditioner 10, the size of each observationpixel 51 is desirably 5 cm×5 cm or smaller in a location 3.6 m away foran air conditioner 10 designed for a 6-jo (roughly 10 m²) room, 4.5 maway for an air conditioner 10 designed for an 8-jo (roughly 13 m²)room, and 7.2 m away for an air conditioner 10 designed for a 12-jo(roughly 19 m²) room. Additionally, in accordance with setting the sizeof each observation pixel 51 smaller, it is desirable that the totalnumber of observation pixels 51 be greater than 512.

The air conditioner 10 may measure the temperature difference betweenthe temperature of the upper part of the user's body and the temperatureof the lower part of the user's body based on the thermal image data.Since this makes it possible to determine whether the user is sensitiveto cold temperatures or not, the air conditioner 10 can increase theintensity of the heating at the user's feet when the heater is in use.The user may choose whether to use this feature or not via the userinterface. With this, the user can choose a desired function.

When there are a plurality of users in the room in which the airconditioner 10 is installed, there are instances where hand temperature(leg temperature) varies from user to user. The air conditioner 10therefore desirably includes a system capable of setting which user isto be a priority user. This makes it possible to provide airconditioning control where the hand temperature (leg temperature) is thetarget value even in a room occupied by a plurality of users havingdifferent hand temperatures (leg temperatures).

Setting for the priority user may be done via the user interface, forexample. FIG. 11A illustrates an example where “B” is selected fromamong four selections (icons) “A”, “B”, “Max”, and “Min” as the priorityuser.

For example, by entering height data for a family in advance, the airconditioner 10 can, as described above, measure the height of a user inthe room from the thermal image data and determine which user is in theroom. Instead of “A” and “B”, user names that are entered in advance(“Dad”, “Sister”, or personal names) may be displayed as the selections(icons).

Moreover, when “Max” illustrated in the example in FIG. 11A is selected,the air conditioner 10 switches to a mode that performs control suchthat the hand temperature of the user having the highest handtemperature among the users in the room is set as the target handtemperature. When “Min” illustrated in the example in FIG. 11A isselected, the air conditioner 10 switches to a mode that performscontrol such that the hand temperature of the user having the lowesthand temperature among the users in the room is set as the target handtemperature. Such modes may also be provided as selections.

In addition to the above modes, a mode that performs control using thebody temperature of the user closest to the air conditioner 10 as areference, and conversely a mode that performs control using the bodytemperature of the user furthest from the air conditioner 10 as areference may also be provided. Furthermore, a mode where a givenlocation is set and performs control using the body temperature of theuser closest to the given location as a reference may also be provided.

In this way, by providing modes that select a user based on location andperform control using the body temperature of the selected user as areference, control that is highly flexible for the user can be achieved.

Moreover, when the body temperatures (hand temperature, leg temperature)of a plurality of users in a room are different, different temperatureenvironments may be provided to different users by adjusting the airflow direction and fan speed, such as sending air in the direction of auser with a high body temperature when the cooler is in use, or sendingair in the direction of a user with a low body temperature when theheater is in use. This makes it possible to provide comfortable in-roomenvironments for a plurality of users.

In the case that a single user is present, the air flow direction andthe fan speed may be adjusted such that the temperature for each of twoor more body parts of a single user (for example, a hand and a leg) is atarget temperature. In this case, for example, the target handtemperature and the target leg temperature are enclosed with a bold lineon the user interface (to indicate that they have been selected by theuser), as illustrated in FIG. 11C. However, controlling the air flowdirection and the fan speed is essential for setting two or more bodyparts as target temperatures.

In other words, in this case, the air flow direction and the fan speedare not settable from the user interface so that the air flow directionand the fan speed cannot be set by the user. In other words, the areafor the air flow direction and the fan speed is displayed on the userinterface as faded (grayed), as illustrated in FIG. 11C. Note thatinstead of displaying them as faded, the user may be notified thatchanging the settings for the air flow direction and the fan speed isnot possible.

The air conditioner 10 may also assess the room layout from thermalimage data of the room. This makes it possible to provide airconditioning that is suited to the user's behavior.

For example, the air conditioner 10 can detect the location of theuser's pillow in order to detect the location of the user's face whilethe user is sleeping. The air conditioner 10 can keep the user's throator facial skin from drying out by avoiding sending air directly to theuser's face while the user is sleeping.

The air conditioner 10 may detect the location of the dining table andstore the location in a memory in the air conditioner 10. This makes itpossible to recognize a period where a user is in the vicinity of thedining table as the user eating a meal, and perform control such asreducing the intensity of the heating if winter time. For example, theair conditioner 10 can recognize a location where a user is from apredetermined point time (for example from 7:00 AM) for a period of 10minutes to 60 minutes as the dining table.

Moreover, when the temperature of an observation pixel 51 correspondingto the dining table is between 100 degrees Celsius and 80 degreesCelsius, the air conditioner 10 can determine that the user is eating ahot pot dish. When the user is determined to be eating a hot pot dish inthe winter time, the air conditioner 10 can moreover perform control toreduce the intensity of the heating. In this case, if the airconditioner 10 includes a dehumidifying function, the air conditioner 10may perform dehumidification in addition to reducing the intensity ofthe heating. The user may choose whether to use this feature or not viaa user interface such as a remote control. This makes it possible toallow the user to select functions based on his or her preferences.

Variation of Embodiment 1

The air conditioner 10 according to Embodiment 1 has been hereinbeforedescribed. Note that in Embodiment 1, the air conditioner 10 isdescribed as being installed inside a room, but the air conditioner 10may be realized as an air conditioner in a vehicle. Note that a specificexample of a vehicle air conditioner will be given later.

Note that in Embodiment 1, the air conditioner 10 measures thetemperature of the user's hand and leg using the thermal image sensor13, but the air conditioner 10 may measure the temperature of the user'shand and leg using a wearable temperature measuring device having acommunication device (for example, a wearable device in the form of awrist watch or a device installed in a shoe (or sock)). In this case,equivalent results are obtained by the temperature measuring deviceregularly notifying the air conditioner 10 of the user's hand and legtemperature via the communication device. Note that using the thermalimage sensor 13 has the advantage of being able to measure thetemperature of the user's hand and leg without requiring the user towear a temperature measuring device.

Moreover, in Embodiment 1, the air conditioner 10 is described asincluding the thermal image sensor 13 internally, but the thermal imagesensor 13 and the air conditioner 10 may be provided separately andconnected over a network through a communication device. However, inthis case, it is desirable that setting of the installation location foreach of the thermal image sensor 13 and the air conditioner 10 beperformed; the integrated configuration described in Embodiment 1 isadvantageous in that setting of the installation location is notrequired.

Embodiment 2 Underlying Knowledge Forming Basis of Embodiment 2

In Embodiment 2, a thermal image sensor will be described. First, theunderlying knowledge forming the basis of the thermal image sensoraccording to Embodiment 2 will be described.

The thermal image sensor 20 having photosensor elements arranged in amatrix described in Embodiment 1 is expensive due to its large size onaccount of the large number of photosensor elements. Although it ispossible to cut costs by reducing the size of each photosensor elementarranged in the matrix in the thermal image sensor 20, this decreasessensitivity and reduces the temperature measurement accuracy.

The thermal image sensor 30 including linearly arranged photosensorelements, however, is low-cost since less photosensor elements than thethermal image sensor 20 are used. However, the thermal image sensor 30takes a long time—a few seconds or more—to measure one frame of thermalimage data. Measuring the movement (amount of activity) of a movingobject, such as a person or a pet, is therefore difficult with thethermal image sensor 30.

Measuring the amount of activity allows for air conditioner control tobe performed in accordance with the amount of activity of each user. Forexample, since the body temperature of a user with a high amount ofactivity increases, more suitable control can be performed by measuringthe amount of activity and increasing the intensity of the cooling orreducing the intensity of the heating accordingly.

Conventionally, in-depth research of thermal image sensors designed tomeasure an amount of activity has not been done. PTL 2 discloses amethod for generating high-resolution two-dimensional thermal image databy shifting a thermal image sensor having one-dimensionally alignedphotosensor elements (arranged in a single line) by a predeterminedamount at a changing point in the scanning direction and continuing withthe next scanning. However, the measurement of an amount of activity isnot considered in PTL 2. Embodiment 2 aims to provide a thermal imagesensor structure appropriate for measuring an amount of activity at lowcost.

[Configuration]

Hereinafter, the configuration of the thermal image sensor according toEmbodiment 2 will be described in detail. In Embodiment 2, multipleconfigurations of the thermal image sensor will be described, but eachconfiguration is merely an example. It is also possible to combine eachof the different configurations of the thermal image sensor to form anew thermal image sensor.

First, the configuration of the thermal image sensor according toEmbodiment 2 will be described. FIG. 12 is an external view of thethermal image sensor according to Embodiment 2. FIG. 13 illustrates thetemperature distribution measurement method employed by the thermalimage sensor according to Embodiment 2.

The thermal image sensor 1000 illustrated in FIG. 12 includes therotator 31 and the lens 33, similar to the thermal image sensor 30. Thethermal image sensor 1000 includes the linear one-dimensionalphotosensor 32, but in contrast to the thermal image sensor 30, thethermal image sensor 1000 includes two lines of the linearone-dimensional photosensor 32 (the one-dimensional photosensors 32 aand 32 b).

The observation pixels 51, in which the thermal image sensor 1000 canconcurrently measure temperature, are included in two linear observationareas: a 1×16 linear observation area 61 a and a 1×16 linear observationarea 61 b, as FIG. 12 illustrates. Each linear observation area 61 a and61 b is scanned from left to right (positive direction of the X axis) inFIG. 13 as the rotator 31 rotates. In other words, the temperature inthe observation pixels 51, in which temperature has been measured as aresult of being included in the linear observation area 61 b, ismeasured again as a result of being included in the linear observationarea 61 a.

Thus, with the thermal image sensor 1000, the thermal image data foreach observation pixel 51 included in the linear observation area 61 aand the thermal image data for each observation pixel 51 included in thelinear observation area 61 b are compared, and the variation in thermalimage data occurring due to the difference in time of measurement oftemperature between the two lines (hereinafter also referred to asthermal image time variation) can be measured. This makes it possiblefor the thermal image sensor 1000 to detect the presence of a movingobject, such as a person or pet.

In other words, with the thermal image sensor 1000, it is possible todetermine the following based on the thermal image time variation.

(1) No moving object is present if there is no thermal image timevariation.

(2) A moving object is present but the speed of the movement is low(amount of activity is low) if the thermal image time variation issmall.

(3) A moving object is present and the speed of the movement is high(amount of activity is high) if the thermal image time variation islarge.

The relational expression for the thermal image time variation andamount of activity in (2) and (3) is set in accordance with thedifference in time of measurement of the linear observation areas 61 aand 61 b or the (assumed) speed of movement of the target object. Forexample, a relational expression where the time variation of thetemperature for each observation pixel 51 is computed, the integratedvalue (for example, the integrated value of a single vertical line) isdefined as the thermal image time variation of a given vertical line,and the amount of activity is proportional to the thermal image timevariation, is conceivable.

Moreover, when the rotator 31 is a stepper motor, the width of one stepis desirably 1/(integer) of the interval between the linear observationareas 61 a and 61 b in the scanning direction (1/(integer) of theinterval between the one-dimensional photosensor 32 a and theone-dimensional photosensor 32 b). With this, the observation pixels 51included in the linear observation area 61 b are, after a few steps,included in the linear observation area 61 a. In other words, it ispossible to detect a moving object with greater accuracy with a simpleprocess by measuring the amount of infrared light in the sameobservation pixel 51 at different times.

Note that when measurement of the temperature of the same observationpixels 51 is conducted multiple times at different times using aplurality of photosensor elements corresponding to a portion of theentire observation area 50, the photosensor elements are desirablyelongated photosensor elements arranged such that the long side isparallel to the scanning direction (rotational direction). With thisconfiguration, by rotating the photosensor less than or equal to therotational direction width of each photosensor element, thermal imagedata that has a high resolution in both directions (X and Y axisdirection) and a high S/N ratio can be obtained.

In this way, the thermal image sensor 1000 uses a plurality ofphotosensors corresponding to a portion of the entire observation area50 to measure the temperature of the same observation pixels 51 multipletimes at different times. Note that the thermal image sensor thatmeasures the amount of activity of an object based on this sort ofconcept is not limited to a configuration like the thermal image sensor1000.

Hereinafter different configurations (variations) of the thermal imagesensor according to Embodiment 2 will be described. The examplesdescribed below include an example in which an amount of infrared lightradiated from locations of different positions or dimensions is measuredat different times rather than an amount of light from the exact samelocation (the same observation pixel 51) being measured at differenttimes. Even with an amount of infrared light radiated from locations ofdifferent positions or dimensions, it is possible to detect a movingobject using an amount of infrared light radiated from a near area or anarea with an overlapping portion.

Hereinafter, for simplification, the (i) arrangement and rotationaldirection of the photosensor elements and (ii) the shape and scanningdirection of the observation areas (observation pixels 51) for whichtemperature is concurrently measured are illustrated in the Drawings.Unless otherwise noted, the thermal image sensor according to thefollowing variations has the same configuration as the thermal imagesensors 30 and 1000, and includes the rotator 31, the photosensor, andthe lens 33.

Note that the variations below are mere examples, and may be combined toform a different embodiment of the thermal image sensor.

Variation 1 of Embodiment 2

(a) in FIG. 14 illustrates the thermal image sensor according toVariation 1 of Embodiment 2. (b) in FIG. 14 illustrates the observationarea of the thermal image sensor illustrated in (a) in FIG. 14.

The thermal image sensor 1300 according to Variation 1 includes threelines of the linear one-dimensional photosensor 32 (the one-dimensionalphotosensors 32 a, 32 b, and 32 c). In other words, as illustrated in(b) in FIG. 14, when the thermal image sensor 1300 is used, the linearobservation areas are formed in three lines—the linear observation area61 a, the linear observation area 61 b, and the linear observation area61 c. As such, the thermal image sensor 1300 can more accurately measurethe amount of movement (speed) of a moving object.

Note that, as illustrated in (a) in FIG. 14, the distance (here,distance refers to distance in the rotational direction; the sameapplies hereinafter) between the one-dimensional photosensor 32 a andthe one-dimensional photosensor 32 b and the distance between theone-dimensional photosensor 32 b and the one-dimensional photosensor 32c are desirably different. This is because it is possible to measure amoving object using thermal image data obtained at a plurality ofdifferent time differences and thus achieve measurement of differencesin the speed of travel of a moving object with a higher degree ofaccuracy.

Variation 2 of Embodiment 2

(a) and (b) in FIG. 15 illustrate the thermal image sensors according toVariation 2 of Embodiment 2. (c) in FIG. 15 illustrates the observationarea of the thermal image sensor illustrated in (a) in FIG. 15, and (d)in FIG. 15 illustrates the observation area of the thermal image sensorillustrated in (b) in FIG. 15.

The thermal image sensors according to Variation 2 include a firstphotosensor element line (the first photosensor element line 1401 a andthe first photosensor element line 1402 b), which is the single-lineone-dimensional photosensor 32, and a second photosensor element group(the second photosensor element line 1402 a and the second photosensorelement group 1402 b) where the distance between the first photosensorelement line 1401 a in the rotational direction is not constant. Thismakes it possible for the thermal image sensors according to Variation 2to measure the speed of travel of a moving object with a high degree ofaccuracy.

For example, in the thermal image sensor 1400 a illustrated in (a) inFIG. 15, the photosensor elements are arranged such that the distancebetween the photosensor elements in the first photosensor element line1401 a and the photosensor elements in the second photosensor elementline 1402 a increases for photosensor elements that are located furtherin the downward vertical direction (further in the negative direction ofthe Y axis). Thus, when the thermal image sensor 1400 a is used, thelinear observation area 61 and the diagonal observation area 1401 areformed, as illustrated in (c) in FIG. 15. With the thermal image sensor1400 a, it is possible to form a linear observation area at low cost.

With the thermal image sensor 1400 b illustrated in (b) in FIG. 15, thephotosensor elements in the second photosensor element group 1402 b arearranged such that their horizontal location is random. In other words,when the thermal image sensor 1400 b is used, the linear observationarea 61 and the non-linear observation area 1402 are formed, asillustrated in (d) in FIG. 15. The thermal image sensor 1400 b performshighly accurate measurement of the speed of travel of smaller objects.

Note that in (a) in FIG. 15, the positional relationship of firstphotosensor element line 1401 a and the second photosensor element line1402 a in the X axis direction may be reversed. In other words, thefirst photosensor element line 1401 a may be located on the X axispositive side of the second photosensor element line 1402 a.

The distance between the photosensor elements in the first photosensorelement line 1401 a and the photosensor elements in the secondphotosensor element line 1402 a may increase with distance in thepositive direction of the Y axis, and may alternatively increase withdistance in the negative direction of the Y axis. The same also appliesto the photosensor elements in the thermal image sensors according toVariation 3 and subsequent variations.

Variation 3 of Embodiment 2

(a) through (d) in FIG. 16 illustrate the thermal image sensorsaccording to Variation 3 of Embodiment 2. (e) through (h) in FIG. 16illustrate the observation areas of the thermal image sensorsillustrated in (a) through (d) in FIG. 16.

The thermal image sensors according to Variation 3 include a pluralityof different sized photosensor elements. This makes it possible to bothmaintain a high temperature accuracy with the larger observation pixels(photosensor elements) and achieve a high-resolution image with thesmaller observation pixels (photosensor elements).

For example, in the thermal image sensor 1500 a illustrated in (a) inFIG. 16, a first photosensor element line 1501 a including photosensorelements of a first size and a second photosensor element line 1502 aincluding photosensor elements of a second size different from the firstsize in the X axis direction (the X axis direction width is smaller) arearranged parallel to each other. The thermal image sensor 1500 a formsthe observation areas illustrated in (e) in FIG. 16. This sort ofconfiguration where photosensor elements having different widths in theX axis direction are provided increases the X axis direction resolutionof the thermal image data.

Moreover, such as is the case with the thermal image sensor 1500 billustrated in (b) in FIG. 16, a first photosensor element line 1501 band a second photosensor element line 1502 b, each of which includephotosensor elements of a first size and photosensor elements of asecond size, may be arranged parallel to each other.

More specifically, in the first photosensor element line 1501 b,photosensor elements of a first size and photosensor elements of asecond size are alternately arranged in the Y axis direction. In thesecond photosensor element line 1502 b, photosensor elements of a firstsize and photosensor elements of a second size are alternately arrangedin the Y axis direction. Consequently, any given pair of photosensorelements adjacent to each other in the X axis direction includes aphotosensor element of the first size and a photosensor element of thesecond size. The thermal image sensor 1500 b forms the observation areasillustrated in (f) in FIG. 16. This sort of configuration wherephotosensor elements having different widths in the X axis direction areprovided increases the X axis direction resolution of the thermal imagedata.

Moreover, such as is the case with the thermal image sensor 1500 cillustrated in (c) in FIG. 16, a first photosensor element line 1501 cincluding photosensor elements of a first size and a second photosensorelement line 1502 c including photosensor elements of a third size thatis both different from (smaller than) the first size in the X axisdirection and the Y axis direction may be arranged parallel to eachother. The thermal image sensor 1500 c forms the observation areasillustrated in (g) in FIG. 16. In this way, including a plurality ofphotosensor elements having a third size that is smaller in both X axisdirection width and Y axis direction (direction perpendicular to thescanning direction) width increases the X axis direction resolution andY axis direction resolution.

Moreover, such as is the case with the thermal image sensor 1500 dillustrated in (d) in FIG. 16, a first photosensor element line 1501 dincluding photosensor elements of a first size and a second photosensorelement line 1502 d including photosensor elements of a fourth size thatis different from the first size in the Y axis direction (smaller in theY axis direction), may be arranged parallel to each other The thermalimage sensor 1500 d forms the observation areas illustrated in (h) inFIG. 16. By forming a collection of the photosensor elements of a fourthsize in a specific location, it is possible to increase the resolutionof a specific area corresponding to the collection of photosensorelements in particular.

Variation 4 of Embodiment 2

(a) and (b) in FIG. 17 illustrate the thermal image sensors according toVariation 4 of Embodiment 2.

The thermal image sensors according to Variation 4 include a pluralityof photosensor elements having different thermal capacities. Morespecifically, the thermal image sensors according to Variation 4 includetwo types of photosensor elements—photosensor elements 1601, andphotosensor elements 1602 that have a lower thermal capacity than thephotosensor elements 1601.

With the thermal image sensor 1600 a illustrated in (a) in FIG. 17, afirst photosensor element line 1601 a including only photosensorelements 1601 and a second photosensor element line 1602 a includingonly photosensor elements 1602 are arranged parallel to each other. Withthe thermal image sensor 1600 b illustrated in (b) in FIG. 17, thephotosensor elements 1601 and the photosensor elements 1602 arealternately arranged in the Y axis direction in both the firstphotosensor element line 1601 b and the second photosensor element line1602 b. Moreover, with the thermal image sensor 1600 b, any given pairof photosensor elements adjacent to each other in the X axis directionincludes the photosensor element 1601 and the photosensor element 1602.

By providing two types of photosensor elements with different thermalcapacities in the thermal image sensor, it is possible to achieve bothan increase in temperature measurement accuracy and measurement of afast moving object. For example, thermopiles of different thicknessesare used as the photosensor elements having different thermalcapacities.

Variation 5 of Embodiment 2

(a) and (b) in FIG. 18 illustrate the thermal image sensors according toVariation 5 of Embodiment 2. The thermal image sensors according toVariation 5 include two types of photosensor elements—photosensorelements 1701 and photosensor elements 1702—that are made of mutuallydifferent materials. More specifically, a conceivable combinationincludes use of thermopiles for the photosensor elements 1701 andphotodiodes for the photosensor elements 1702, for example.

With the thermal image sensor 1700 a illustrated in (a) in FIG. 18, afirst photosensor element line 1701 a including only photosensorelements 1701 and a second photosensor element line 1702 a includingonly photosensor elements 1702 are arranged parallel to each other. Withthe thermal image sensor 1700 b illustrated in (b) in FIG. 18, thephotosensor elements 1701 and the photosensor elements 1702 arealternately arranged in the Y axis direction in both the firstphotosensor element line 1701 b and the second photosensor element line1702 b. Moreover, with the thermal image sensor 1700 b, any given pairof photosensor elements adjacent to each other in the X axis directionincludes the photosensor element 1701 and the photosensor element 1702.

Although cost increases, this configuration is superior to theconfiguration in which the thickness of the thermopiles is changed(Variation 4) in regard to both an increase in temperature measurementaccuracy and measurement of a fast moving object.

Variation 6 of Embodiment 2

(a) and (b) in FIG. 19 illustrate the thermal image sensors according toVariation 6 of Embodiment 2. (c) and (d) in FIG. 19 illustrate theobservation areas of the thermal image sensors illustrated in (a) and(b) in FIG. 19.

The photosensor element lines of the thermal image sensors according toVariation 6 include a different number of elements. More specifically,the thermal image sensor 1800 a illustrated in (a) in FIG. 19 includes afirst photosensor element line 1801 a and a second photosensor elementline 1802 a including a fewer number of photosensor elements than thefirst photosensor element line 1801 a (the second photosensor elementline 1802 a includes half the number of photosensor elements included inthe first photosensor element line 1801 a). The thermal image sensor1800 b illustrated in (b) in FIG. 19 includes a first photosensorelement line 1801 b and a second photosensor element line 1802 bincluding a fewer number of photosensor element than the firstphotosensor element line 1801 b. The second photosensor element lines inthe thermal image sensor 1800 a and the thermal image sensor 1800 bdiffer in that the plurality of photosensor elements included thereinare arranged dispersed (in intervals of one) or arranged in a continuousmanner.

The thermal image sensor 1800 a forms the observation areas illustratedin (c) in FIG. 19 and the thermal image sensor 1800 b forms theobservation areas illustrated in (d) in FIG. 19. With this, since it ispossible to reduce the number of photosensor elements to an amount fewerthan the thermal image sensor 1000, the thermal image sensors 1800 a and1800 b can detect moving objects at less cost than the thermal imagesensor 1000.

Note that a merit of the thermal image sensor 1800 a is that it candetect a moving object regardless of the location of the moving object,and a merit of the thermal image sensor 1800 b is that the detectionaccuracy of a moving object in a specific area corresponding to thecollection of photosensor elements is high.

Variation 7 of Embodiment 2

(a) through (c) in FIG. 20 illustrate the thermal image sensorsaccording to Variation 7 of Embodiment 2. (d) through (f) in FIG. 20illustrate the observation areas of the thermal image sensorsillustrated in (a) through (c) in FIG. 20. The thermal image sensoraccording to Variation 7 includes a plurality of photosensor elementlines, and the position of each photosensor element in each photosensorelement line is shifted in a direction perpendicular to the rotationaldirection (that is, shifted in the Y axis direction). The thermal imagesensor 2000 a illustrated in (a) in FIG. 20 includes two photosensorelement lines, and the thermal image sensor 2000 b illustrated in (b) inFIG. 20 and the thermal image sensor 2000 c illustrated in (c) in FIG.20 include three photosensor element lines.

The thermal image sensor 2000 a forms a plurality of linear observationareas where the positions of the observation pixels 51 are shifted inthe Y axis direction, such as is the case with the observation areas1910 and 1911 illustrated in (d) in FIG. 20. Similarly, the thermalimage sensor 2000 b forms the plurality of linear observation areasillustrated in (e) in FIG. 20. With this, high-sensitivity thermal imagedata with a high Y axis direction resolution is obtained.

The amount that the observation pixels 51 are shifted in the Y axisdirection is desirably ½ the Y axis direction width of a singleobservation pixel 51 (a single photosensor element) in the case of thethermal image sensor 2000 a which includes two photosensor elementlines, desirably ⅓ the Y axis direction width in the case of the thermalimage sensor 2000 b which includes three photosensor element lines, anddesirably 1/n (n being a natural number) the Y axis direction width inthe case of a thermal image sensor which includes n photosensor elementlines. With this, higher resolution thermal image data is obtained withfewer pixels.

Note that in a thermal image sensor including n lines of photosensorelements, the advantageous effect of high-resolution imaging can beobtained even when the amount of shift is not 1/n, but the advantageouseffect increases with proximity to 1/n.

Moreover, as illustrated in (d) and (e) in FIG. 20, ends of the linearobservation areas are desirably formed of partial observation pixels1901 through 1906. In other words, in the thermal image sensors 2000 aand 2000 b, photosensor elements whose Y axis direction length isabnormal (partial photosensor elements) are desirably provided at endsof the photosensor element lines.

For example, the partial observation pixels 1901 and 1904 formed by thethermal image sensor 2000 a are one-half the Y axis direction length ofthe observation pixels 1907 and 1908. As another example, the partialobservation pixels 1903 and 1905 formed by the thermal image sensor 2000b are two-thirds the Y axis direction length of the normal observationpixels 51, and the partial observation pixels 1902 and 1906 areone-third the Y axis direction length of the normal observation pixels51. This makes it possible to obtain thermal image data with a highdegree of temperature accuracy (a high S/N ratio). Note that the Y axisdirection width of the partial observation pixels 1901 through 1906 ismost desirably equal to the shift amount (shift width) of theobservation pixels 51 since a higher S/N ratio is obtainable, butdesigning the width to be different from the observation pixel 51 shiftamount still yields an advantageous effect to a certain degree.

The above-described partial observation pixels are formed by providingphotosensor elements of small pixel size in the thermal image sensor.However, as illustrated in FIG. 21, the partial observation pixels canbe formed by covering (edge-cutting) the photosensor elements (thesephotosensor elements have the same pixel size as other pixels) locatedat the ends of the photosensor element line with a blinder 3801 having aknown temperature.

Next, a technique of high-quality imaging by pixel shifting used by thethermal image sensors 2000 a and 2000 b will be described with referenceto FIG. 22. FIG. 22 illustrates a technique for achieving a high-qualityimage by pixel shifting.

First, at the point in time illustrated in (a) in FIG. 22 (at the pointin time of step 1), the partial observation pixel 1901 includes only thein-room fixed partition 2001, and the observation pixel 1909 includesboth the in-room fixed partition 2002 and the in-room fixed partition2003.

Next, (b) in FIG. 22 illustrates the point in time after two steps from(a) in FIG. 22 (the point in time of step 3)—that is to say, the pointin time after the observation area shifts two pixels in the scanningdirection from the state illustrated in (a) in FIG. 22. At this point intime, the observation pixel 1907 includes the in-room fixed partitions2001 and 2002, and the observation pixel 1908 includes the in-room fixedpartitions 2003 and 2004.

First, the amount of infrared light radiated from the in-room fixedpartition 2001 is computed from data on the amount of infrared lightfrom the partial observation pixel 1901 at the point in time of step 1((a) in FIG. 22).

Next, the amount of infrared light radiated from the in-room fixedpartition 2002 is computed from the difference between data on theamount of infrared light from the partial observation pixel 1907 at thepoint in time of step 3 ((b) in FIG. 22) and data on the amount ofinfrared light from the partial observation pixel 1901 at the point intime of step 1 ((a) in FIG. 22).

Next, the amount of infrared light radiated from the in-room fixedpartition 2003 is computed from the difference between data on theamount of infrared light from the partial observation pixel 1909 at thepoint in time of step 1 ((a) in FIG. 22) and the computed data on theamount of infrared light from the in-room fixed partition 2002.

Next, the amount of infrared light radiated from the in-room fixedpartition 2004 is computed from the difference between data on theamount of infrared light from the partial observation pixel 1908 at thepoint in time of step 3 ((b) in FIG. 22) and the computed data on theamount of infrared light radiated from the in-room fixed partition 2003.The same shall apply hereinafter.

With this method, when the time variation of the amount of infraredlight radiated from each in-room fixed partition (time variation betweenstep 1 and step 3) is great, high-quality imaging is difficult toachieve. Consequently, the two photosensor element lines in the thermalimage sensor 2000 a should be arranged as close together as possible.With a small measurement time interval for the linear observation areasformed by the two photosensor element lines, further high-qualityimaging (high accuracy) can be achieved.

Moreover, as is the case with the thermal image sensor 2000 cillustrated in (c) in FIG. 20, providing the thermal image sensor 2000 awith one additional photosensor element line forms the linearobservation area 2101, as illustrated in (f) in FIG. 20. Here, thepixels in the linear observation area 2101 are not shifted with respectto either the linear observation area 1901 or the linear observationarea 1911 (in this case, the linear observation area 1910).

With this configuration, by comparing the data on the amount of infraredlight for the linear observation area 1910 with the data on the amountof infrared light for the linear observation area 2101, it is possibleto estimate the time variation (variation in the amount of infraredlight between steps) of the amount of infrared light radiated from eachin-room fixed partition. With this, further high-quality imaging (highaccuracy) can be achieved.

Note that in the above-described technique for high-quality imaging bypixel shifting, an example is conceivable in which the partialobservation pixel 1901 is not formed as a result of the thermal imagesensor 2000 a not including any partial photosensor elements. In thiscase, for example, the amount of infrared light for the in-room fixedpartition 2001 is computed by assuming that the amount of infrared lightis the same as the amount of infrared light for the observation pixel1907.

Note that the photosensor element lines may be shifted in the X axisdirection. FIG. 23 illustrates one example of observation areas when thephotosensor element lines are shifted in the X axis direction.

As illustrated in (a) and (b) in FIG. 23, the distance between theplurality of linear observation areas (distance between the plurality ofphotosensor element lines) may be shifted by an integer multiple of thewidth of each linear observation area. In this case, as illustrated in(a) in FIG. 23, the distance is desirably shifted by one-half of a pixelwhen there are two lines of linear observation areas, and by 1/n of apixel when there are n lines of linear observation areas. With this,thermal image data with a high X axis direction resolution is obtained.

Moreover, when the distance between a plurality of linear observationareas is an integer multiple of the width of each linear observationarea, the width of one step (rotation amount) of the rotator 31 isdesirably less than the width of the photosensor element (for example,one-half or one-third of the width). Even in this sort of configuration,the same increase in resolution of the thermal image data can beachieved as the above-described case where the distance between thelinear observation areas is shifted. However, from the perspective ofmeasurement speed, a configuration in which the distance between thelinear observation areas is shifted is desirable.

The same increase in resolution achieved with the configuration in whichthe distance between the linear observation areas is shifted can also beachieved with the use of baffles. FIG. 24 illustrates a technique forachieving a high-resolution image with baffles.

As illustrated in FIG. 24, at least one baffle 2301 (two baffles areprovided in FIG. 24) may be provided in an area around the thermal imagesensor to block infrared light in a portion of the linear observationareas located at the left and right ends of the entire observation area50. In this case, so long as the infrared light at the ends of theentire observation area 50 can be blocked, the arrangement of the baffle2301 is not limited to a specific example. With this, the same increasein resolution achieved with the configuration in which the distancebetween the linear observation areas is shifted is achieved.

Variation 8 of Embodiment 2

(a) in FIG. 25 illustrates the thermal image sensor according toVariation 8 of Embodiment 2. (b) in FIG. 25 illustrates the observationarea of the thermal image sensor illustrated in (a) in FIG. 25. Asillustrated in (a) in FIG. 25, in the thermal image sensor according toVariation 8, the boundary directions A and B, which are the directionsin which boundaries between adjacent photosensor elements lie, sloperelative to both the X axis direction and the Y axis direction. Morespecifically, the boundary direction A intersects the X axis directionand the Y axis direction at a 45 degree angle, and the boundarydirection B intersects the X axis direction and the Y axis direction ata 45 degree angle. The thermal image sensor 2500 forms the observationareas (observation pixels) illustrated in (b) in FIG. 25 is formed.

With this configuration, two lines of linear observation areas can beformed such that the center of the observation pixels of one line areshifted one-half of a pixel (here, one pixel is equivalent to the cornerto corner length of a square observation pixel) in the X axis directionrelative to the other line, and the dimensions of each observation pixel(each photosensor element) can be increased.

For example, with the configuration like the one illustrated in FIG. 23,the distance between two lines of linear observation areas (distance inthe X axis direction) is at least one pixel or more. In contrast, withthe configuration of the thermal image sensor 2500, it is possibleachieve a distance between linear observation areas (distance in the Xaxis direction) that is one pixel or less, thereby allowing the thermalimage sensor 2500 to detect movement of a fast moving object. Moreover,with the thermal image sensor 2500, it is possible to increase thedimensions of each photosensor element, thereby increasing temperaturemeasurement accuracy.

In the thermal image sensor 2500, if the width of one step (rotationamount) in the scanning direction (rotational direction) is one pixel orless, it is possible to increase the resolution of the thermal imagedata in both the X axis direction and the Y axis direction. Theprinciple behind this increase in resolution is the same as withVariation 7.

Similarly, with the thermal image sensor 2500, two lines of linearobservation areas whose central positions are shifted in the X axisdirection are formed. Consequently, the measurement accuracy of thespeed (amount of activity) of the object is high with the thermal imagesensor 2500.

Note that in this case, the width of one step in the scanning direction(rotational direction) is desirably 1/n pixel (for example, one-half ofa pixel).

The configuration in which the boundary directions of the photosensorelements slope relative to both the X axis direction and the Y axisdirection is not limited to the configuration illustrated in FIG. 25.FIG. 26 illustrates an example of a different observation area accordingto Variation 8 of Embodiment 2.

The observation area illustrated in FIG. 26 is formed of one photosensorelement line including photosensor elements aligned in a direction thatintersects both the X axis direction and the Y axis direction. Thethermal image sensor that forms the observation area illustrated in FIG.26 can be achieved by simply arranging the one-dimensional photosensor32 of the thermal image sensor 30 described with reference to FIG. 5 ona slope, making it possible manufacture the thermal image sensor at lowcost. Moreover, the thermal image sensor that forms the observation areaillustrated in FIG. 26 can obtain thermal image data for the entireobservation area with greater speed.

Moreover, the thermal image sensor that forms the observation areaillustrated in FIG. 26 can perform scanning in the Y axis direction inaddition to the X axis direction. FIG. 27 illustrates scanning in the Yaxis direction. As illustrated in FIG. 27, when a heat source (the faceof a person) in the entire observation area is detected by scanning inthe X axis direction, the thermal image sensor further scans only thearea surrounding the heat source in the Y axis direction. When the heatsource detected by the X axis direction scanning is a person's body,this increases the measurement accuracy of the height of the persondetected.

Note that two or more different sized photosensor elements may bearranged in the thermal image sensor according to Variation 8. FIG. 28illustrates an example of observation areas when two or more differentsized photosensor elements are arranged in the thermal image sensoraccording to Variation 8.

The observation areas illustrated in FIG. 28 include normal sizedobservation pixels 2602 and partial observation pixels 2601 that aresmaller than the observation pixels 2602. Thermal image data with agreater S/N ratio is obtained with this configuration.

Note that the length of one side of the partial observation pixel 2601is desirably one-half the length of one side of the observation pixel2602, which makes it possible to obtain thermal image data having agreater S/N ratio. Moreover, in addition to the partial observationpixel 2601, the observation areas may include a partial observationpixel having one side that is one-half the size of the partialobservation pixel 2601 (in other words, one-fourth the area). With this,thermal image data with an even greater S/N ratio is obtained.

Other Variations

Similar to the thermal image sensors 30 and 1000, the thermal imagesensor according to Embodiment 2 generally includes the rotator 31, agiven embodiment of the photosensor, and the lens 33.

The configuration of the thermal image sensor, however, is not limitedto this configuration. For example, a configuration which omits therotator 31 is conceivable. FIG. 29 illustrates one example of thethermal image sensor having a configuration in which the photosensor is(photosensor elements are) caused to shift.

The thermal image sensor 2700 illustrated in FIG. 29 includes the samelens 22 described with reference to FIG. 2 and a photosensor 2701 inwhich photosensor elements are arranged in the same fashion as thethermal image sensor 1400 a illustrated in (a) in FIG. 15. Thephotosensor 2701 shifts (scans) behind the back surface (the sideopposite the side to which the observation target is located) of thelens 22. Note that the thermal image sensor 2700 forming the sameobservation area as the thermal image sensor 1400 a is one example; thearrangement of the photosensor elements in the thermal image sensor 2700may be reversed horizontally or vertically depending on theconfiguration of the optical system.

Moreover, scanning may be performed by moving a structural element otherthan the photosensor. FIG. 30 illustrates one example of the thermalimage sensor which performs scanning by moving a structural elementother than the photosensor.

As illustrated in FIG. 30, the thermal image sensor 2800 includes amirror 2801, a lens 2802, and a photosensor 2803. The mirror 2801reflects infrared light radiated from an observation target such thatthe light is incident on the lens 2802. The infrared light reflected bythe mirror 2801 is transmitted through the lens 2802 and received by thephotosensor 2803.

In this example, the photosensor 2803 itself does not move or rotate;scanning is performed by rotating the mirror 2801. Note that the mirroris rotated by a driving device (not shown in the Drawings).

With the thermal image sensor 2800, the lens 2802 is arranged betweenthe mirror 2801 and the photosensor 2803, but the lens 2802 may bebonded to the reflective surface of the mirror 2801, and alternativelymay be arranged between the mirror 2801 and the observation target. Aconfiguration in which the lens 2802 is omitted and the mirror 2801 is aconcave mirror is also acceptable.

Note that with the thermal image sensors 2700 and 2800, the photosensorelements are arranged as illustrated in (a) in FIG. 15, but thearrangement of the photosensor elements is not limited to this example.

Moreover, the image processing method and the arrangement of theobservation pixels in the thermal image sensor described in Embodiment 2that allows for measurement of a moving object and high-resolutionimaging can be applied to all types of image sensors that generateimages by scanning a linear sensor. This image processing method andarrangement of the observation pixels may be used in, for example, adetection apparatus which uses linear sensors and is used on amanufacturing line in an industrial plant.

Moreover, when the air conditioner 10 according to Embodiment 1 includesthe thermal image sensor according to Embodiment 2, the air conditioner10 can more accurately detect a user, measure the body surfacetemperature of the user, and provide air conditioning accordingly.

[Conclusion]

The thermal image sensor according to Embodiment 2 includes a pluralityof infrared sensor elements (hereinafter also referred to as infrareddetector elements) that detect infrared light in an observation area(hereinafter also referred to as a detection area), and a scanningdevice that scans the detection area in a scanning direction to detect,with the plurality of infrared detector elements, infrared light in anarea to be captured as a single thermal image. The plurality of infrareddetector elements include infrared detector elements arranged indifferent positions in the predetermined direction (for example, therotational direction of the rotator 31). Here, the predetermineddirection is equivalent to the scanning direction in the arrangement ofthe plurality of infrared detector elements.

For example, the plurality of infrared detector elements are aligned inan intersecting direction intersecting both the predetermined directionand a direction perpendicular to the predetermined direction, such as isthe case with the second photosensor element line 1402 a illustrated inFIG. 15.

Moreover, for example, the plurality of infrared detector elementsconstitute a plurality of element lines each configured of a portion ofthe plurality of infrared detector elements, and the plurality ofelement lines are arranged in mutually different positions in thepredetermined direction. Examples of this sort of element line includethe one-dimensional photosensors 32 a, 32 b, and 32 c illustrated inFIG. 12 and FIG. 14 among others.

Moreover, the plurality of element lines may include an element line ofinfrared detector elements aligned in a direction perpendicular to thepredetermined direction and an element line of infrared detectorelements aligned in a direction intersecting both the predetermineddirection and the direction perpendicular to the predetermineddirection. Examples of this sort of element line include the firstphotosensor element line 1401 a and the second photosensor element line1402 a illustrated in FIG. 15.

Moreover, as illustrated in FIG. 19, among the plurality of elementlines, a total number of infrared detector elements constituting oneelement line may be different from a total number of infrared detectorelements constituting another element line.

Moreover, as illustrated in FIG. 17 and FIG. 18, the plurality ofinfrared detector elements may include two types of infrared detectorelements different in at least one of shape, thermal capacity, size, ormaterial.

Moreover, the scanning device in the thermal image sensor according toEmbodiment 2 may scan the detection area in the scanning direction bymoving the plurality of infrared detector elements in the predetermineddirection. This sort of scanning device is, for example, the rotator 31.

Moreover, the scanning device may include an optical system thatintroduces infrared light from a target object to the plurality ofinfrared detector elements, and the scanning device may scan thedetection area in the scanning direction by moving the optical system.This sort of scanning device is, for example, the structure that drivesthe lens 22 illustrated in FIG. 29, or the structure that rotates themirror 2801 illustrated in FIG. 30.

The thermal image sensor according to Embodiment 2 is lower in cost thanthe thermal image sensor 20 in which the infrared detector elements arearranged in a matrix, and more suited for measurement of an amount ofactivity of a person than the thermal image sensor 30 in which theinfrared detector elements are arranged in a line.

Embodiment 3

In Embodiment 3, a vehicle and a vehicle air conditioner that conditionsthe air in the cabin of the vehicle based on the temperaturedistribution inside the cabin of the vehicle will be described. Notethat since the vehicle air conditioner according to Embodiment 3 is theair conditioner 10 according to Embodiment 1 applied to a vehicle,overlapping descriptions are omitted.

Additionally, the vehicle according to Embodiment 3 is a vehicle thatincludes the air conditioner according to Embodiment 1 and thefollowing, and various measurement systems (hygrometer, system formeasuring an amount of scattered light, etc.).

The vehicle air conditioner according to Embodiment 3 includes a heatexchanging system and a blower system, heats or cools air drawn into theair conditioner from outside the vehicle, and then expels the heated orcooled air to air condition the cabin of the vehicle. Similar toEmbodiment 1, the vehicle air conditioner includes a system formeasuring the temperature of a user, and can provide air conditioning inaccordance with the state of the user by controlling the heat exchangingsystem and the blower system based on the body surface temperature ofthe user.

[Configuration]

Hereinafter, two examples of configurations of the vehicle airconditioner according to Embodiment 3 will be described. FIG. 31illustrates the first example of the vehicle air conditioner accordingto Embodiment 3. FIG. 32 illustrates the second example of the vehicleair conditioner according to Embodiment 3. The vehicle air conditioner3100 illustrated in FIG. 31 and the vehicle air conditioner 3200illustrated in FIG. 32 include a compressor 3000 as the heat exchangingsystem, an evaporator 3001, a condenser 3002, and a receiver 3003.

First, operation when the cooler is in use will be described.Refrigerant compressed by the compressor 3000 is inputted into thecondenser 3002 and cooled by the outside air. With this, liquefiedrefrigerant is sent to the receiver 3003. The refrigerant sent to thereceiver 3003 is separated into liquefied and non-liquefied refrigerant,and moisture is removed with, for example, a drying agent.

The liquefied refrigerant is injected into the evaporator 3001 from thesmall nozzle of the expansion valve and vaporized, and the evaporator3001 cools as a result of heat being drawn from around the evaporator3001. Air drawn into the cabin of the vehicle from outside the vehicleby an intake system 3005 is provided to the cooled evaporator 3001 andreturned to the inside of the cabin by the blower system 3004. Since theair sent into the cabin of the vehicle by the blower system is providedto the evaporator 3001 and cooled, it is possible to reduce thetemperature of the air inside the cabin of the vehicle.

Moreover, when using the heater, the method of using exhaust from theengine to heat the air, similar to a typical vehicle air conditioner, isused. However, in the case of a vehicle that generates a small amount ofheat, such as an electric vehicle, heating is desirably achieved using acompressor, similar to a household air conditioner. This improves theefficiency of the vehicle air conditioner.

As described above, the vehicle air conditioners 3100 and 3200 include asystem for measuring the temperature of a user in addition to systemsfor heating and cooling the air inside the cabin of the vehicle.Hereinafter, the method for measuring the temperature of a user will bedescribed.

With the vehicle air conditioner 3100, temperature sensors 3006 areprovided in parts of the vehicle in contact with the user, such as inthe steering wheel and seats, to measure the temperature of the user.

In contrast, with the vehicle air conditioner 3200, a thermal imagesensor 3101 is provided inside the cabin of the vehicle to measure thetemperature of the user. Here, the thermal image sensor 3101 may be anykind of thermal image sensor. For example, the thermal image sensordescribed in Embodiments 1, 2, and 4 is used as the thermal image sensor3101.

The method where a plurality of temperature sensors are used, such as isthe case with the vehicle air conditioner 3100, is desirable in that itis possible to measure the temperature of various parts of the user'sbody at low cost. In contrast, the method where the thermal image sensor3101 is used, such as is the case with the vehicle air conditioner 3200,is desirable in that it is possible to measure a part of the user thatis not touching the steering wheel or seat and measure the environmentaltemperature inside the cabin of the vehicle with a single sensor.

Moreover, a contact temperature sensor and thermal image sensor may beused in conjunction. This allows for the temperature of more parts ofthe user's body to be measured, and allows for air conditioning moreaccurately suited to the body surface temperature of the user.

Note that since the system configuration of the vehicle air conditioner3200 is the similar to the system configuration of the air conditioner10 (or air conditioner 10 a) according to Embodiment 1, detaileddescription thereof is omitted. Similar to Embodiment 1, based on theoutput from the thermal image sensor 3101, the vehicle air conditioner3200 computes, for example, which seat the user is sitting in, the bodysurface temperature of the user, and the temperature of a side windownear the user. Moreover, air conditioning suited to the state andenvironment of the user is provided as a result of a device controllerin the vehicle air conditioner 3200 adjusting the rotational speed ofthe compressor or the fan speed.

At least a portion of the driver's seat is included in the observationarea (not shown in the Drawings) of the thermal image sensor 3101, whichallows for air conditioning suited to the body surface temperature ofthe driver.

The observation area of the thermal image sensor 3101 may include onlythe area surrounding the steering wheel at the driver's seat. Thisallows for air conditioning suited to the body surface temperature (handtemperature) of the driver using a minimal observation area. Unlike acontact temperature sensor installed in the steering wheel, the thermalimage sensor 3101 is capable of measuring the temperature of the user'shand instantly regardless of where the user is holding the steeringwheel. Moreover, since the observation area is small, high-resolutionthermal image data can be obtained at low cost, and the measurementaccuracy of the user's hand temperature increases.

The observation area of the thermal image sensor 3101 may include thepassenger seat in addition to the driver's seat. This allows for airconditioning suited to both the driver and the passenger.

The observation area of the thermal image sensor 3101 may also includethe rear seats, as is the case with in the observation area 3102illustrated in FIG. 31, which allows for air conditioning suited to thebody surface temperature of each passenger including passengers seatedin the rear seats.

When the cabin of the vehicle is air conditioned to suit a plurality ofusers, the vehicle air conditioners 3100 and 3200 desirably include aplurality of blower systems. This makes it possible for the vehicle airconditioners 3100 and 3200 to accurately adjust the air temperaturearound each user.

The vehicle air conditioners 3100 and 3200 more desirably include aplurality of intake systems. This makes it possible for the vehicle airconditioners 3100 and 3200 to accurately adjust the air temperaturearound each user.

[User Interface]

The vehicle air conditioners 3100 and 3200 desirably include a userinterface. More specifically, the vehicle air conditioners 3100 and 3200desirably include the user interface described in Embodiment 1 withreference to FIG. 11A through FIG. 11C.

Moreover, the above-described blower system, intake system, and userinterface are more desirably provided individually for each seat. Thismakes it possible for each user sitting in each seat to individually setthe temperature.

The above-described blower system, intake system, and user interface aredesirably provided as an integrated unit. With this, a more low-costvehicle air conditioner can be realized.

In vehicles not having a blower system for each seat, a user sitting ina given seat when the car is in motion may be selected as a priorityuser from the user interface. In this case, the vehicle air conditioners3100 and 3200 may provide air conditioning under the pretense that theselected user body surface temperature is the target temperature. Thevehicle air conditioner can be realized at lower cost than when blowersystems are provided individually for each seat.

Vehicles not having user interfaces for each seat may be provided with auser interface capable of assessing the state of each seat. FIG. 33illustrates an example of the user interface according to Embodiment 3.Since the user interface illustrated in FIG. 33 is installed in thevicinity of the driver's seat, the driver can control the airconditioning for each seat.

The user interface illustrated in FIG. 33 assigns symbols such as theletters A through E to each seat, and displays a person-shaped icon foreach seat. In the person-shaped icons, the body surface temperature ofeach user is indicated with color (the color is illustrated in shadingin the Drawings). The person-shaped icon is displayed with a solidoutline when a user is sitting in that seat, and displayed with a dashedline when a user is not sitting that seat. This allows for moreintuitive assessment of the state of the users in the cabin of thevehicle. Whether or not a user is sitting in a particular seat isdetermined from the thermal image data. For example, the determinationcondition is whether or not an object that is 30 degrees Celsius or moreis in a particular seat.

Moreover, the user interface may display the target temperature for eachuser and allow each user to change their target temperature. A framedarea pointing to the foot of the icon for seat A and a framed areapointing to the hand of the icon for seat B are displayed in the userinterface illustrated in FIG. 33, and the target temperature isdisplayed in each framed area. This illustrates that a foot temperatureof 28 degrees Celsius is set as the target temperature for the usersitting in seat A, and a hand temperature of 30 degrees Celsius is setas the target temperature for the user sitting in seat B.

A framed area which does not point to any body part is displayed for theicon for seat C. This illustrates that an environmental temperature(temperature of the surrounding air) of 25 degrees Celsius is set as thetarget temperature for the user sitting in seat C.

This sort of display makes it possible to know the target temperaturesinside the cabin of the vehicle at a glance.

Moreover, as illustrated in FIG. 33, the user interface may display anicon for steering wheel. This makes it possible to more intuitivelygrasp the location of the driver's seat..

As illustrated in FIG. 33, when the vehicle air conditioners 3100 and3200 are installed in an electric vehicle or a combustion enginevehicle, the distance capable of being traveled may be estimated basedon the remaining amount of fuel and the current air conditionersettings, and the estimated distance may be displayed. This makes itpossible for the user to check the distance capable of being traveled inreal time.

As illustrated in FIG. 33, the user interface may display the distanceuntil the destination and the probability of reaching the destination.This allows the user to check the probability of reaching thedestination and adjust the air conditioner accordingly.

As illustrated in FIG. 33, the user interface may include a system forincreasing the distance capable of being traveled and the probability ofreaching the destination (such as the triangle icons). This makes itpossible for the user to prioritize the air conditioner and theprobability of reaching the destination.

For example, when the user sets the distance capable of being traveledto 110 km, in order to travel the set distance capable of beingtraveled, the target temperature (set temperature) for each user isautomatically changed. To increase the distance capable of beingtraveled, the set temperature for each user is decreased in the casethat the heater is being used, and increased in the case that the cooleris being used.

The same also applies to the probability of reaching the destinationsuch that when, for example, the user sets the probability of reachingthe destination to be 90%, the target temperature is changed in order toachieve a probability of reaching the destination of 90%.

Moreover, the observation area 3102 of the thermal image sensor 3101 mayinclude a side window. Measurement of a side window by the vehicle airconditioner 3200 allows for radiant heat radiating from the side windowto the user to be taken into account. This allows the vehicle airconditioner 3200 to more accurately measure the thermal sensation of theuser and provide air conditioning according to the thermal sensation.

More desirably, the observation area 3102 of the thermal image sensor3101 includes both the side window next to the driver's seat and theside window next to the passenger's seat. This allows the vehicle airconditioner 3200 to provide air conditioning for each seat in accordancewith the amount of radiated heat from each of the side window next tothe driver's seat and the side window next to the passenger's seat. Forexample, the target temperature is set lower for seats closer to sidewindows of a high temperature (large amount of radiated heat).

[Prediction of Condensation]

The observation area 3102 of the thermal image sensor 3101 desirablyincludes the windshield. This allows for prediction of condensation,which will be described later. FIG. 34 illustrates a vehicle airconditioner having an observation area including the windshield.

The observation area 3201 of the vehicle air conditioner 3300illustrated in FIG. 34 includes the windshield 3203. The vehicle airconditioner 3300 illustrated in FIG. 34 further includes a hygrometer3202, allowing the vehicle air conditioner 3300 to measure the humidityon the surface of the windshield 3203 based on both the humidity insidethe cabin of the vehicle and the temperature (saturated vapor pressure)of the windshield 3203 measured by the thermal image sensor 3101. Withthis, the vehicle air conditioner 3300 can predict the accumulation ofcondensation on the windshield 3203 and prevent condensation fromaccumulating by drawing in air from outside the vehicle beforecondensation accumulates on the windshield 3203.

The vehicle air conditioner 3300 may include a structure fordehumidifying the air inside the cabin of the vehicle in addition toventilating the inside of the cabin of the vehicle by drawing in airfrom outside the vehicle. With this, when, for example, the air outsidethe vehicle is not clean, the vehicle air conditioner 3300 can preventthe accumulation of condensation without ventilating the air.

As described above, the thermal image sensor 3101, which measurestemperature across a wide area, including, for example, the driver'sseat, passenger's seat, both side windows, and the windshield 3203, mayinclude the rotator 31 described in Embodiments 1 and 2. This will makeit possible to achieve a high-resolution thermal image sensor 3101 thatis low-cost and covers a wide area.

The hygrometer 3202 may be integrated with the thermal image sensor3101, or may be provided separately. When the hygrometer 3202 isprovided separately from the thermal image sensor 3101, the hygrometer3202 and the thermal image sensor 3101 may each include a communicationdevice, and the vehicle air conditioner 3300 may include a signalprocessor that predicts the accumulation of condensation in tandem withinformation from both the communication devices.

Next, ventilation operation based on condensation prediction will bedescribed. FIG. 35 is a flow chart for ventilation operation based oncondensation prediction.

The signal processor in the vehicle air conditioner 3300 measures thetemperature of the windshield using the thermal image sensor 3101 (S21),and then measures the humidity using the hygrometer 3202 (obtains thesensor output from the hygrometer 3202) (S22). The signal processor thenpredicts the accumulation of condensation based on the measurementresults—that is to say, computes the humidity of the windshield surface(S23).

When the humidity of the windshield surface is less than a giventhreshold (for example, 95%), the signal processor determines that“condensation will not accumulate” (No in S24), and continues regularlymeasuring the windshield surface temperature and humidity (S21 and S22).

When the humidity of the windshield surface is the given threshold orgreater, the signal processor determines that “condensation willaccumulate” (Yes in S24), and confirms whether to ventilate with theuser (S25). At this time, confirmation with the user may be performedaurally, and may be performed by displaying text on a display such as acar navigation system. The user may respond by voice or interacting withthe panel, and when the user does not approve the ventilation (No inS26), the signal processor stops processing. Note that in this case, thesignal processor may reconfirm with the user after waiting for a givenperiod of time and stop processing after failing to receive approval anumber of times.

When the user approves the ventilation (Yes in S26), the signalprocessor starts ventilation (S27).

As illustrated in FIG. 36, note that if the vehicle air conditioner 3300includes a dehumidifying system, when the user does not approve theventilation (No in S26), the dehumidifier may be turned on (S28). Thisallows the vehicle air conditioner 3300 to prevent the accumulation ofcondensation without ventilating the air. In this case, the signalprocessor may confirm with the user whether to turn the dehumidifier onor not before turning the dehumidifier on.

The vehicle air conditioner 3300 desirably includes a system formeasuring the condition of the air outside the vehicle. For example, byincluding a spectroscopic sensor that measures the carbon monoxide levelor hydrocarbon level outside the vehicle, the vehicle air conditioner3300 can monitor the condition of the air outside the vehicle, andprovide air conditioning accordingly. For example, it is possible toselect between performing ventilation when the air outside the vehicleis clean (the carbon monoxide level and hydrocarbon level in the air arelow) and using the dehumidifier when the air outside the vehicle is notclean (the carbon monoxide level and hydrocarbon level in the air arehigh). Moreover, when performing the selection, the vehicle airconditioner 3300 may notify the user of the condition of the air outsidethe vehicle, and the vehicle air conditioner 3300 may include an audioor touch panel user interface for determining the user's choice. Thisallows for air conditioning that is in line with the user's intentions.

The vehicle (mobile object) including the vehicle air conditioner 3300may include a scattered light measurement system that measures an amountof scattered light on the outside and inside surfaces of the windshield.FIG. 37 illustrates a vehicle including the scattered light measurementsystem.

The vehicle 3400 illustrated in FIG. 37 includes the scattered lightmeasurement system 3501. With this, when the amount of scattered lighton the outside and inside surfaces of the windshield is great regardlessof whether or not the windshield surface humidity inside the vehicle islow (80% or less) it is possible to determine that condensation isaccumulating on the outside surface of the windshield (the side outsideof the vehicle).

When condensation accumulates on the outside surface of the windshield,the vehicle 3400 desirably turns on the windshield wipers automaticallyto eliminate the scattering of light by the condensation. This makes itpossible to eliminate the need for the user to discern whether thecondensation is accumulated on the inside or outside of the vehicle, andachieve a system that automatically removes condensation.

One example of the scattered light measurement system 3501 is aconfiguration which includes a laser light source and a photodiode,projects the laser light at an angle relative to the windshield, andmeasures the amount of laser light returning by the backscatterphenomenon with the photodiode.

Another example of the scattered light measurement system 3501 is aconfiguration which uses a camera to photograph an area in front of thewindshield, through the windshield. In the image obtained by the camera,areas of condensation vary little in color between neighboring pixels,and areas free of condensation change greatly when the vehicle istraveling. This allows for measurement of the scattering of light.

The vehicle 3400 (or the vehicle air conditioner 3300) may include acommunication device. This makes it possible to share, in the cloud,positional (regional) information on where the vehicle 3400 traveledwhen condensation accumulated on the outside surface of the windshield.Consequently, the vehicle 3400 can provide information on regions thatwill likely cause condensation to accumulate on the windshield to othervehicles which do not include the scattered light measurement system3501.

When the vehicle 3400 (or the vehicle air conditioner 3300) includes acommunication device, the vehicle 3400 can, for example, obtain, via thecommunication device, history information on whether the user bathed orate before getting in the vehicle from the user's home bath system andkitchen appliances, such as a microwave. Using information obtained inthis manner, air conditioning suited to the user's thermal sensation canbe achieved.

Variation of Embodiment 3

Similar to Embodiment 1, the vehicle air conditioner according toEmbodiment 3 may measure the temperature of a plurality of parts of theuser's body, such as the forehead, hand, leg, nose, ear, and cheek,etc., and provide air conditioning where the target temperature is thetemperature of a given part or parts of the users body.

As described in Embodiment 1, when the heat exchanger is a compressor,increasing the number of rotations increases the intensity of thecooling and reducing the number of rotations reduces the intensity ofthe cooling. By increasing the intensity of the cooling when the user'sbody surface temperature is greater than the target temperature andreducing the intensity of the cooling when the user's body surfacetemperature is less than the target temperature, it is possible toprovide air conditioning that brings the user's body surface temperaturecloser to the target temperature.

Similar to Embodiment 1, the vehicle air conditioner according toEmbodiment 3 may determine whether the user is wearing glasses, a mask,gloves, socks, or slippers, etc., based on the thermal image data. Thevehicle air conditioner according to Embodiment 3 may include a systemfor notifying the user of a decrease in measurement accuracy based onthe user wearing, for example, glasses, a mask, gloves, socks, orslippers, etc., based on the above detection result. Since the methodfor executing the above is the described in Embodiment 1, repetition ofthe description here will be omitted.

The vehicle air conditioner according to Embodiment 3 may includesystems for computing, based on the thermal image data, an amount ofclothes, radiant heat, humidity, posture, an amount of activity, anamount of exercise, time, sweat, and the season. This allows for airconditioning that is more suited to the user's thermal sensation. Sincethe methods for executing the above computations are the described inEmbodiment 1, repetition of the descriptions here will be omitted.

The vehicle air conditioner according to Embodiment 3 may include alighting system that illuminates the observation area of the thermalimage sensor 3101. For example, as illustrated in FIG. 37, the thermalimage sensor 3101 of the vehicle air conditioner may include thelighting system 3502, and alternatively the lighting system may beprovided adjacent to the thermal image sensor 3101. With this, the usercan easily confirm the area where the temperature is being measured(which is the area illuminated) by the thermal image sensor 3101.

Note that the lighting system is desirably a lighting system that shineslight only on the entire observation area of the thermal image sensor3101. This makes it possible for the user to accurately confirm thelocation of the entire observation area 50.

The thermal image sensor 3101 of the vehicle air conditioner accordingto Embodiment 3 may include a far-infrared irradiation system, andalternatively may be adjacent to the far-infrared irradiation system. Inthis case, is it desirable that the optical system be designed such thatthe further a target object to which far-infrared light is radiated isfrom the far-infrared irradiation system, the lower the density of thefar-infrared light received as a result of the radiation is.

The vehicle air conditioner having such a configuration can assess thedistance between each area in the observation area and the thermal imagesensor 3101 by comparing thermal image data when far-infrared light isradiated toward the observation area with thermal image data whenfar-infrared light is not radiated. This is because the greater thevariation between the radiation thermal image data and the non-radiationthermal image data, the closer an object is to the thermal image sensor3101. With this, the vehicle air conditioner can recognize anobstruction that blocks the flow of air in the cabin of the vehicle(such as large luggage placed next to the passenger seat), and controlthe flow of air such that the air flows around the obstruction to theuser. By, for example, selectively controlling the flow of air such thatair only flows from a blower system with no obstruction between it anthe user, low power consumption can be achieved.

When the vehicle (or vehicle air conditioner) according to Embodiment 3includes a thermal image sensor, the vehicle can recognize whether aperson is in a given seat or not. Recognizing the location of a userwith the thermal image sensor is superior to recognizing the location ofa user with a sensor that measures the load on a seat because thethermal image sensor does not falsely recognize luggage as a person.This allows the vehicle according to Embodiment 3 to be capable ofinstructing the user to fasten his or her seatbelt only in cases wherethe user is sitting in the passenger seat, for example.

Embodiment 4 Underlying Knowledge Forming Basis of Embodiment 4

it is common knowledge that even in the same hygrothermal environment,what the temperature “feels like” to a user varies depending on theuser's amount of activity. For example, even in an environment with atemperature of 25 degrees Celsius and 50% humidity, which is generally acomfortable environment for an average person who is not moving, if theperson exercises vigorously, they will feel hot.

By knowing how active the person in that location is, it is possible toadjust parameters such as the temperature and fan speed of the airconditioner in accordance with the person's amount of activity. Thisadjusting provides a comfortable environment for people with a highamount of activity.

In light of this, a configuration has been proposed that improves thelevel of comfort by computing an amount of activity from data obtainedfrom an infrared detector and feeding back the amount of activity to theair conditioner, such as the configuration in PTL 1.

Moreover, a technique of using, for example, an infrared detector as adetector for measuring the temperature distribution in a room has beenproposed, and in order to increase the detection range of the infrareddetector, a technique of scanning an array infrared detector in a givendirection has been proposed, such as in PTL 2.

However, with the infrared detectors disclosed in PTL 1 and PTL 2, whena person is in the scanning range, the person is only scanned once perscanning instance. Normally, one instance of scanning takes tens ofseconds to a few minutes, so using the infrared detectors disclosed inPTL 1 and PTL 2 to measure the amount of activity of a person isdifficult. In particular, when the infrared detectors disclosed in PTL 1and PTL 2 are used to detect the amount of activity of a person, it isdifficult to perform the detection in a wide area.

In Embodiment 4, an infrared detector capable of detecting the amount ofactivity of a person in a wide area will be described. Note that theinfrared detector according to Embodiment 4 is a device that correspondsto the thermal image sensors according to Embodiments 1 through 3, andthe infrared detector element according to Embodiment 4 is an elementthat corresponds to the photosensor element according to Embodiments 1through 3.

[Configuration]

First, the configuration of the infrared detector according toEmbodiment 4 and the configuration of the air conditioner including theinfrared detector will be described. FIG. 38 is a diagrammatic view of aroom in which the air conditioner 100 including the infrared detectoraccording to Embodiment 4 is installed. FIG. 39A is a perspective viewof the infrared detector according to Embodiment 4, and FIG. 39B is aside view of the infrared detector according to Embodiment 4.

As illustrated in FIG. 38, the infrared detector 101 according toEmbodiment 4 is installed in the air conditioner 100. The airconditioner 100 is illustrated as being installed in a room inhabited bya person 102 and including a desk 103.

As illustrated in FIG. 39A and FIG. 39B, the infrared detector 101(thermal image sensor) includes infrared detector elements (photosensorelements) 105 a through 105 f, and the infrared detector elements 105 athrough 105 f are mounted on rotors (rotators) 104 a through 104 f,respectively. When the infrared detector 101 is viewed from above, eachrotor 104 a through 104 f rotates in a clockwise direction.

Furthermore, as illustrated in FIG. 39B, the side surface 107 a of therotor 104 a is perpendicular to the top surface 106 a of the rotor 104a, but the side surface 107 b of the rotor 104 b is sloped 8 b degreesrelative to the top surface 106 b of the rotor 104 b, and the diameterof the rotor 104 b gradually decreases toward the bottom. Additionally,the side surface 107 c of the rotor 104 c slopes inward θc degrees,which is greater than 8 b degrees, relative to the top surface 106 c ofthe rotor 104 c, and the diameter of the rotor 104 c gradually decreasestoward the bottom.

Similarly the side surface 107 d of the rotor 104 d slopes inward θddegrees, which is greater than θc degrees, relative to the top surface106 d of the rotor 104 d, and the diameter of the rotor 104 d graduallydecreases toward the bottom. The same also applies for the rotors 104 eand 104 f, and the side surfaces θb, θc, θd, θe, and θf of the rotorsfulfill the relationship θb<θc<θd<θe<θf such that the mounted infrareddetector elements are angled further downward on lower positionedrotors.

In this way, by configuring the infrared detector elements 105 a through105 f such that the vertical orientation of each element is different,the infrared detector elements 105 a through 105 f measure thetemperature at locations located at different heights in the room.

Note that among the infrared detector elements 105 a through 105 f,infrared detector elements positioned higher detect (measure) areaslocated higher in the room, but the relation between the position of theinfrared detector element and the measurement area is not limited tothis example. Additionally, the side surface 107 a of the rotor 104 amay, similar to the side surfaces of the other rotors, slope at an anglenot perpendicular to the top surface 106 a. Moreover, the measurement(detection) range and angle may be adjusted by attaching, for example, alens to each of the infrared detector elements 105 a through 105 f.

In the infrared detector 101, the infrared detector elements 105 athrough 105 f are offset from each other in the rotational direction ofthe rotors 104 a through 104 f by a predetermined amount. In FIG. 39Aand FIG. 39B, from the top rotor to the bottom rotor, each infrareddetector element 105 a through 105 f is attached more toward the frontwith respect to the rotational direction.

Next, the infrared image (thermal image data) measured by the infrareddetector 101 installed on the air conditioner 100 will be described withreference to FIG. 40A through FIG. 40E. FIG. 40A through FIG. 40E areconceptual diagrams illustrating detection areas of the infrareddetector 101.

As illustrated in FIG. 39A and FIG. 39B, the infrared detector elements105 a through 105 f mounted on the infrared detector 101 are offset fromeach other in the rotational direction by a predetermined amount.Consequently, the locations in which infrared light is detected(locations at which temperature is measured) by the infrared detectorelements are offset from each other in the scanning direction—that is tosay, horizontally in the infrared image—by a predetermined amount.

FIG. 40A conceptually illustrates the detection areas 108 a through 108f of the infrared detector elements 105 a through 105 f when detectionstarts. In the state illustrated in FIG. 40A, the infrared detectorelement 105 f is the leading element in the rotational direction(hereinafter, the direction equivalent to the scanning direction (here,the rotational direction) in the arrangement of the infrared detectorelements is also referred to as the scanning direction). Consequently,the detection area 108 f is located in the leading position in thescanning direction. The locations in the scanning direction that theinfrared detector elements detect are offset from each other by apredetermined amount. At the point in time illustrated in FIG. 40A, thedesk 103 is within a detection area of the infrared detector 101, butthe person 102 is not yet within a detection area.

FIG. 40B illustrates the detection areas 108 a through 108 f one frameafter the start of the detection (the state illustrated in FIG. 40A). Asdescribed with reference to FIG. 39A and FIG. 39B, when the infrareddetector 101 is viewed from above, the rotational direction of theinfrared detector 101 is a clockwise direction. Thus, the detectionareas one frame after the start of the detection are shifted one pixelto the right relative to the detection areas at the start of thedetection illustrated in FIG. 40A. At the point in time illustrated inFIG. 40B, the desk 103 is within a detection area of the infrareddetector 101, but the person 102 is not yet within a detection area.

FIG. 40C illustrates the detection areas 108 a through 108 f two framesafter the start of the detection. The detection areas 108 a through 108f are shifted two pixels to the right relative to the detection areas atthe start of the detection. Thus, at the point in time illustrated inFIG. 40C, the left leg 102 a of the person 102 has entered the detectionarea 108 f, and temperature measurement of the left leg 102 a has began.Next, three frames after the start of the detection (not shown in theDrawings), the left leg 102 a of the person 102 enters the detectionarea 108 e, and thereafter the person 102 is sequentially captured ineach detection range.

Here, when the rotors 104 a through 104 f of the infrared detector 101continue rotating in the same direction (clockwise direction), the timeperiod that any given one of the detection areas 108 a through 108 fcaptures the person 102 is, after the start of the detection, from thesecond frame (FIG. 40C) to the ninth frame (FIG. 40D). At the point intime illustrated in FIG. 40D, the detection area 108 a, which is thelast detection area in the scanning direction, captures the head 102 bof the person 102.

Note that eleven frames are required for each detection area to returnto the starting position at the start of the detection. Thus, with theinfrared detector 101, in eight of the eleven frames (from frame two toframe nine), the person 102 is a detection target of at least one of theinfrared detector elements 105 a through 105 f.

Note that if each rotor 104 a through 104 f of the infrared detector 101rotates back (in the reverse direction) when each detection area reachesthe right hand end of the scanning range, the person 102 remains adetection target from the second frame through the twelfth frame, asillustrated in FIG. 40E.

In this case, each detection area takes twenty frames to return to thestarting position of the detection in a single round trip of eachdetection element. Thus, in eleven of the twenty frames (from frame twoto frame twelve), the person 102 is a detection target of at least oneof the infrared detector elements 105 a through 105 f.

As a comparison to the infrared detector 101, next an infrared detectorin which the infrared detector elements 105 a through 105 f are arrangedin a straight vertical line will be described along with the detectionareas thereof. FIG. 41 is a perspective view of an infrared detector inwhich the infrared detector elements 105 a through 105 f are arranged ina straight vertical line. FIG. 42A through FIG. 42C are conceptualdiagrams illustrating detection areas of the infrared detectorillustrated in FIG. 41.

The infrared detector 110 illustrated in FIG. 41 includes infrareddetector elements which are not offset from each other in the rotationaldirection. As illustrated in FIG. 42A, at the start of the detection bythe infrared detector 110, the detection areas 109 a through 109 f ofthe infrared detector 110 are aligned vertically in the left most columnin the scanning range.

The person 102 is first detected by the infrared detector 110 in theseventh frame illustrated in FIG. 42B, and continues to be a detectiontarget until the ninth frame illustrated in FIG. 42C.

Note that eleven frames are required for each detection area to returnto the starting position at the start of the detection when the rotors104 a through 104 f of the infrared detector 110 continually rotate inthe same direction. With the infrared detector 110, the person 102 isonly a detection target of the infrared detector elements 105 a through105 f for three of eleven frames (frame seven to frame nine).

Note that if each rotor 104 a through 104 f of the infrared detector 110rotates back (in the reverse direction) when each detection area reachesthe right hand end of the scanning range, twenty frames are required foreach detection area to return to the starting position at the start ofthe detection illustrated in FIG. 42A.

In this case, the person 102 is only a detection target of the infrareddetector elements 105 a through 105 f for six frames—from the seventhframe to the ninth frame and from the eleventh frame to the thirteenthframe (in other words, for six of twenty frames).

As described above, with the infrared detector 101, the position atleast one infrared detector element is shifted in the scanningdirection. The infrared detector 101 has the following advantageouseffects.

Generally, when amount of activity is measured by scanning by theinfrared detector, the amount of activity is estimated from thedifference in (i) the temperature distribution of the room obtained bythe first instance of scanning (first piece of thermal image data) and(i) the temperature distribution of the room obtained by the secondinstance of scanning (second piece of thermal image data).

For example, when thermopile elements including, for example, silicon,are used as the infrared detector elements, a few seconds may berequired for the detection of one frame. Assuming it takes three secondsto detect one frame, in the example illustrated in FIG. 40A through FIG.40D, it takes thirty three seconds to detect the eleven frames requiredto obtain one piece of thermal image data.

When the infrared detector 110 is used, the person 102 is only adetection target for three of the eleven frames. In other words, theperiod of time during which the amount of activity of the person 102 isnot obtained is long since the temperature distribution of the person102 is only measured for nine out of the thirty three seconds.

In contrast, with the infrared detector 101, since the infrared detectorelements 105 a through 105 f are offset from each other, the temperaturedistribution of the person 102 is measured for eight of the elevenframes, or twenty four out of thirty three seconds. The infrareddetector 101 is therefore capable of obtaining the amount of activity ofthe person 102 throughout almost the whole time period, regardless ofthe fact that the infrared detectors are scanning-type detectors.

Thus, with the infrared detector 101, it is possible to precisely assessthe amount of activity of the person 102. The air conditioner 100including the infrared detector 101 can thus provide comfortable airconditioning in accordance with the precisely measured amount ofactivity of the user.

Note that the same is true even if each rotor 104 a through 104 f of theinfrared detector 101 rotates back in the reverse direction when eachdetection area reaches the right hand end of the scanning range.

The infrared detector 110 can only measure the temperature distributionof the person 102 for six of the twenty frames, or eighteen out of sixtyseconds. In contrast, the infrared detector 101 can measure thetemperature distribution of the person 102 for eleven of the twentyframes, or thirty three out of sixty seconds. The infrared detector 101is therefore capable of obtaining the amount of activity of the person102 throughout a majority of time period, regardless of the fact thatthe infrared detectors are scanning-type detectors.

Note that the infrared detector 101 includes six infrared detectorelements, but the number of infrared detector elements is notparticularly limited to a certain number.

In the infrared detector 101, the attachment positions of the infrareddetector elements to their respective rotors are offset from each otherin the scanning direction by a predetermined amount. In other words, inthe infrared detector 101, no two infrared detector elements arearranged in the same position in the scanning direction. However, solong as at least some of the infrared detector elements are offset fromeach other in the scanning direction, it is possible to achieve theadvantageous effect of detecting a person for a majority of the timeperiod. In other words, the manner in which the infrared detectorelements are offset from each other is not limited to the configurationexemplified with infrared detector 101.

The rotational direction of a rotor, the scanning width of one frame,and other scanning parameters in the infrared detector 101 are just oneexample, and are not limited in particular. Various modifications may bemade to the infrared detector 101 so long as they do not depart from theessence of the infrared detector 101.

Variation 1 of Embodiment 4

Hereinafter, the infrared detector according to Variation 1 ofEmbodiment 4 will be described. FIG. 43A is a perspective view of theinfrared detector according to Variation 1 of Embodiment 4. FIG. 43B isa top view of the infrared detector according to Variation 1 ofEmbodiment 4.

The infrared detector 200 illustrated in FIG. 43A and FIG. 43B includesan infrared detector element array 202 on a substrate 201, and animaging lens 205 affixed to the substrate 201 via a mount not shown inthe Drawings. The substrate 201 is affixed to an axle 204, and rotationof the axle 204 collectively rotates the infrared detector element array202 and the imaging lens 205 on the substrate 201. This allows theinfrared detector 200 to scan in a horizontal direction. Note that theimaging lens 205 may be formed from, for example, germanium, zincselenide (ZnSe), or silicon, which have low absorption of infraredlight.

As illustrated in FIG. 43A, the infrared detector 200 includesrectangular infrared detector elements 203 a through 203 f aligneddiagonally in the infrared detector element array 202. In other words,in the infrared detector 200, the infrared detector element array 202(the infrared detector elements 203 a through 203 f) is arranged in asingle plane on a slope of a predetermined angle relative to thescanning direction.

Similar to the infrared detector 101, this infrared detector 200 iscapable of obtaining the amount of activity of the person 102 throughoutalmost the whole time period, regardless of the fact that the infrareddetector is scanning-type detector, by rotation of the substrate 201about the axle 204. In other words, with the infrared detector 200, itis possible to precisely assess the amount of activity of the person102. The air conditioner 100 including the infrared detector 200 canthus provide comfortable air conditioning in accordance with theprecisely measured amount of activity of the user.

Note that in FIG. 43B, the infrared detector rotates in a clockwisedirection, but when the scanning direction is reversed when eachdetection area reaches the right hand end of the scanning range, theinfrared detector 200 may rotate in a counter-clockwise direction.

Variation 2 of Embodiment 4

Hereinafter, the infrared detector according to Variation 2 ofEmbodiment 4 will be described. FIG. 44A is a perspective view of theinfrared detector according to Variation 2 of Embodiment 4. FIG. 44B isa top view of the infrared detector according to Variation 2 ofEmbodiment 4.

The infrared detector 210 illustrated in FIG. 44A and FIG. 44B issimilar to the infrared detector 200, but different in that the infrareddetector 210 does not include the axle 204, and the imaging lens 205 isnot affixed to the substrate 201 and, as illustrated in FIG. 44B, canshift in the horizontal direction (scanning direction) via a structurenot shown in the Drawings.

Similar to when the scanning direction is reversed with the infrareddetector 101, the infrared detector 210 is capable of obtaining theamount of activity of the person 102 throughout almost the whole timeperiod, regardless of the fact that the infrared detector is ascanning-type detector. In other words, with the infrared detector 210,it is possible to precisely assess the amount of activity of the person102. The air conditioner 100 including the infrared detector 210 canthus provide comfortable air conditioning in accordance with theprecisely measured amount of activity of the user.

Variation 3 of Embodiment 4

Hereinafter, the infrared detector according to Variation 3 ofEmbodiment 4 will be described. FIG. 45 is a perspective view of theinfrared detector according to Variation 3 of Embodiment 4.

The infrared detector 220 illustrated in FIG. 45 includes the infrareddetector element array 202 on the substrate 201, and the imaging lens205. The infrared detector element array 202 and the imaging lens 205are the same as those included in the infrared detector 200.

With the infrared detector 220, however, the substrate 201, the infrareddetector element array 202, and the imaging lens 205 do not move at all;a mirror 221 provided above the imaging lens 205 rotates centrally aboutan axle 222. The infrared detector 220 differs from the infrareddetector 200 in this regard. More specifically, the mirror 221 reflectsinfrared light incident from the left hand side in FIG. 45 downward. Thereflected infrared light is transmitted through the imaging lens 205 anda distribution of the infrared light is imaged on the infrared detectorelement array 202.

In this way, by rotating the mirror 221 about the axle 222, the numberof moveable parts are kept to a minimum, and the infrared detector 220is capable of obtaining the amount of activity of the person 102throughout almost the whole time period, regardless of the fact that theinfrared detector is a scanning-type detector. In other words, with theinfrared detector 220, it is possible to precisely assess the amount ofactivity of the person 102. The air conditioner 100 including theinfrared detector 220 can thus provide comfortable air conditioning inaccordance with the precisely measured amount of activity of the user.

Moreover, with the infrared detector 220, the mirror 221 centered aboutthe axle 222 is the only moveable part, and the mirror 221 does notinclude, for example, wires. The infrared detector 220 is thereforeadvantageous in that it has a simplified, low-cost, and long servicelife structure.

Note that in this case, the imaging lens 205 may be attached to themirror 221. FIG. 46 is a perspective view of an infrared detector inwhich the imaging lens 205 is attached to the mirror 221.

The infrared detector 230 illustrated in FIG. 46 is similar to theinfrared detector 220, but different only in that the imaging lens 205is attached to the mirror 221. Note that in FIG. 46, the mirror 221 towhich the imaging lens 205 is displayed as a mirror with lens 231.

The infrared light incident on the imaging lens 205 reaches the mirror221 after transmitting through the imaging lens, reflects off the mirror221, and then transmits through the imaging lens 205 one more time. Thereflected infrared light exiting the imaging lens 205 is incident on theinfrared detector element array 202, whereby a distribution of theinfrared light is imaged on the infrared detector element array 202.

The infrared detector 230 has the same advantageous effects as theinfrared detector 220. Moreover, with the infrared detector 230, sincethe infrared light is transmitted through the same imaging lens 205twice, it is possible to reduce the focal length even with a singlelens, and thus possible to increase the temperature distributionmeasurement range.

Variation 4 of Embodiment 4

Hereinafter, the infrared detector according to Variation 4 ofEmbodiment 4 will be described. FIG. 47 is a perspective view of theinfrared detector according to Variation 4 of Embodiment 4.

The infrared detector 240 illustrated in FIG. 47 is similar to theinfrared detector 200. With the infrared detector 240, however, thecenter of the substrate 201 is cut out, and the infrared detectorelement array 202 is provided on the cutout portion, which is supportedby an axle 241. The axle 241 extends horizontally and is supported bythe substrate 201, which allows the infrared detector element array 202to rotate vertically relative to the illustration in FIG. 47.

With the infrared detector 240, the imaging lens 205 is affixed to theinfrared detector element array 202 with a mount not shown in theDrawings. With this, scanning in the vertical direction in accordancewith rotation of the axle 241 in addition to scanning in the horizontaldirection in accordance with rotation of the axle 204 is possible,allowing the infrared detector 240 to sense infrared light over a widerange, and obtain a temperature distribution over a wider range.

For example, when the presence of the person 102 is detected based onamount of activity (FIG. 40C) upon performing horizontal scanning (FIG.40A through FIG. 40C), the infrared detector 240 stops rotation of theaxle 204, affixes the position in the horizontal direction, and rotatesthe axle 241. This allows for temperature distribution measurement inthe vertical direction, as illustrated in FIG. 48A. FIG. 48A throughFIG. 48C are conceptual diagrams illustrating detection areas whenvertical scanning is performed. Note that FIG. 48A illustrates thedetection areas at the start of the vertical scanning. FIG. 48Billustrates the detection areas after the scanning has progressed upwardfrom the state illustrated in FIG. 48A, and FIG. 48C illustrates thedetection areas after the scanning has progressed downward from thestate illustrated in FIG. 48A.

As illustrated in FIG. 48A through FIG. 48C, by performing horizontalscanning of an area where sites of interest are likely to appearregularly and only performing vertical scanning when a site of interestis found, regularly scanning of a wide area is not required.Consequently, with the infrared detector 240, the time it takes toperform one instance of scanning is reduced, and more detailed controlof the air conditioner 100 is possible.

Moreover, since the infrared detector 240 can analyze the temperaturedistribution of a surrounding area of the person 102 in detail, theinfrared detector 240 is capable of obtaining a more precise amount ofactivity of the person 102. Consequently, the air conditioner 100including the infrared detector 240 can thus provide comfortable airconditioning in accordance with an amount of activity of the user.

Note that conceivable methods of detecting the person 102 from atemperature distribution include detecting (determining), among thedetected temperature distribution, a portion in which an object within apredetermined temperature range from approximately 30 degrees Celsius to36 degrees Celsius is detected, to be the person 102. Various othermethods are conceivable as well, including determining an area, of apredetermined temperature range, exceeding a predetermined size to be aperson, but the method for detecting the person 102 is not particularlylimited.

Moreover, a method of determining an area detected as the person 102 tobe a target of interest and detecting the temperature distribution ofthe surrounding area in detail is described above, but an object otherthan the person 102 may be a target of interest. FIG. 49 illustrates anexample where an object other than the person 102 is a target ofinterest (detection target). FIG. 50 is a conceptual diagram of thedetection areas when a room including a light is scanned in a verticaldirection.

As illustrated in FIG. 49, when the light 242 is present in the room,the presence of the light 242 is detected by scanning a wide area in avertical direction, as illustrated in FIG. 50. Since the light does notgenerate heat when it is off, the infrared detector 240 cannot detectthe light 242 when it is off. However, the light is detectable when itis on since it generates heat.

Therefore, for example, when the infrared detector 240 detects an areaof varying temperature by vertically scanning a wide area and thenfocuses detection of the thermal distribution on the area surroundingthe detected area, and then the location of the area of varyingtemperature does not further vary for a predetermined period of time orlonger, the infrared detector 240 can recognize that area as a consumerelectronics device (that is operating), not a person. The consumerelectronics device is, for example, the light illustrated in FIG. 49 andFIG. 50, or another device that generates heat.

The infrared detector 240 can further detect the amount of powerconsumption in the room or household in advance, and determine whatkinds of consumer electronics devices are in operation from an analysisof the changes in power consumption amount. For example, by obtaining(recording) in advance information on the power consumption of differenttypes of consumer electronics devices, such as information that thepower consumption of a ceiling light is approximately 50 W and the powerconsumption of a liquid crystal television is approximately 100 W, theinfrared detector 240 can differentiate between consumer electronicsdevices based on the difference in power consumption before and afteroperation of the consumer electronics device.

Moreover, when the infrared detector 240 detects a high temperature or alow temperature area in particular, focuses scanning on the surroundingarea, and then detects that that area is a high temperature area havinga temperature greater than or equal to a predetermined temperature, or alow temperature area having a temperature less than or equal to apredetermined temperature, the infrared detector 240 may alert the user(person 102). In this case, the area detected to be of high temperatureis assumed to be, for example, a consumer electronics device that isgenerating an irregular amount of heat, and the area detected to be oflow temperature is assumed to be, for example, a freezer with the doorleft open. With this, in addition to air conditioning, the infrareddetector 240 can provide ease of mind and contribute to providing asafer environment.

Note that the structure of the infrared detector 240 is merely oneexample, and is not particularly limited so long as the structure of theinfrared detector 240 can perform vertical and horizontal scanning.Various modifications may be made to the infrared detector 240 so longas they do not depart from the essence of the infrared detector 240.

Variation 5 of Embodiment 4

Next, as Variation 5 of Embodiment 4, achieving a high-resolutioninfrared image with the infrared detector element array will bedescribed. FIG. 51A is a perspective view of the infrared detectoraccording to Variation 5 of Embodiment 4. FIG. 51B is a top view of theinfrared detector according to Variation 5 of Embodiment 4.

The infrared detector 250 illustrated in FIG. 51A is similar to theinfrared detector 200. In the infrared detector element array 202 of theabove-described infrared detector 200, the infrared detector elements203 a through 203 f are arranged (aligned) such that the sides of eachelement are perpendicular or parallel to the scanning direction. Forexample, as illustrated in FIG. 43A, the infrared detector element 203 bis only in contact with the infrared detector element 203 a at the upperleft corner.

Conversely, in the infrared detector element array 252 of the infrareddetector 250, the infrared detector elements 253 a through 253 f arearranged such that the sides of each element are sloped at a φ degreeangle, as illustrated in FIG. 51A. Furthermore, the infrared detectorelements 253 a through 253 f are in contact with adjacent infrareddetector elements on their sides, not corners. The infrared detector 200and the infrared detector element array 252 are the same regarding otherpoints, and as a result of the infrared detector 250 including theimaging lens 205 which is mounted to the substrate 201 and rotates aboutthe axle 204, it is possible to detect the temperature distribution overa wide range.

Characteristics of the infrared detector 250 including the infrareddetector element array 252 will be described with reference to FIG. 52.FIG. 52 is a conceptual diagram illustrating detection areas of theinfrared detector 250.

Note that in the following description, the angle φ is assumed to be 45degrees in FIG. 51A. Moreover, the respective areas in which theinfrared detector elements 253 a through 253 f perform detection are thedetection areas 258 a through 258 f.

When scanning is performed from left to right, such as is the case inFIG. 52, the detection target of the detection area 258 a of theinfrared detector element 253 a is area A (area whose vertical heightextends in the scanning direction of A). Similarly, the detection targetof the detection area 258 b of the infrared detector element 253 b isarea B, and the respective detection areas of the detection areas 258 cthrough 258 f of the infrared detector elements 253 c through 253F areareas C through F.

The bottom half of area A and the top half of area B overlap. Similarly,the bottom half of area B and the top half of area C overlap, andsimilarly the top half (bottom half) of each area overlaps with thebottom half (top half) of the detection target area of the adjacentinfrared detector element. Here, the top half of area A is referred toas area (1), the overlapping portion of area A and area B is referred toas area (2), the overlapping portion of area B and area C is referred toas area (3), and the areas thereafter are referred to as areas (4)through (7), as illustrated in FIG. 52.

For example, when a heat generating body is present only in area (3),the heat generating body is detected by both the infrared detectorelements 253 b and 253 c, but not detected by the infrared detectorelement 253 a or the infrared detector element 253 d. Consequently, itis specified that a heat generating object is present in area (3).

Since the detection ranges (detection target areas) of adjacent infrareddetector elements overlap in a direction perpendicular to the scanningdirection, the infrared image resolution in the direction perpendicularto the scanning direction increases. FIG. 53 illustrates a technique forincreasing the resolution of the infrared image.

In FIG. 53, the infrared detector element 108 and the infrared detectorelement 258 are illustrated as having the same size (dimensions). Theinfrared detector element 108 is arranged such that the four sidesthereof are either horizontal or perpendicular to the scanningdirection, and the infrared detector element 258 is arranged such thatthe four sides thereof are sloped φ degrees (45 degrees) with respect tothe scanning direction, similar to FIG. 52. Here, the detection width inthe vertical direction of the infrared detector element 108 is X, butthe detection width Y in the vertical direction of the infrared detectorelement 258 is, as a result of the above-described overlapping, smallerthan X such that Y is equal to X times one over the square root of two.In other words, the resolution of the infrared image measured from thearrangement of the infrared detector element 258 increases over theinfrared image measured from the arrangement of the infrared detectorelement 108 by a multiple of the square root of two.

As described above, it is possible to increase the resolution of theinfrared image by arranging the infrared detector elements such that thedetection ranges overlap each other in a direction perpendicular to thescanning direction.

Note that in the above description, the angle φ is assumed to be 45degrees, but this is merely one example. In a direction perpendicular tothe scanning direction, so long as the detection ranges of adjacentinfrared detector elements overlap, another angle is acceptable, andanother arrangement is also acceptable.

Variation 6 of Embodiment 4

Next, the infrared detector according to Variation 6 of Embodiment 4will be described. FIG. 54 is a perspective view of the infrareddetector according to Variation 6 of Embodiment 4.

Similar to the infrared detector 250, the infrared detector 260illustrated in FIG. 54 includes an infrared detector element array 262of infrared detector elements 263 a through 263 f aligned at an angle φrelative to the horizontal direction. In the infrared detector 260, theangle φ is adjustable about a rotating structure 264, and verticalscanning is also possible due to an axle 261 supporting the infrareddetector element array 262.

The imaging lens 205 is affixed to the infrared detector element array262 with a mount not shown in the Drawings. With this configuration, theinfrared detector 260 is capable of arbitrarily changing the resolutionof the infrared image. FIG. 55 illustrates a technique for changing theresolution of the infrared image.

In FIG. 55, the detection areas 268 a through 268 f are the respectivedetection areas for the infrared detector elements 263 a through 263 f.

For example, when the angle φ is greater than 45 degrees, the detectionrange of the detection area 268 c is area C. Here, in addition to area B(the detection range of detection area 268 b) and area D (the detectionrange of detection area 268 d), area A (the detection range of detectionarea 268 a) and area E (the detection range of detection area 268 e)overlap with area C. The infrared detector 260 can therefore obtain aninfrared image of an even higher resolution.

For example, the infrared detector 260 is capable of obtaining thefollowing sort of infrared image (temperature distribution). First, theinfrared detector 260 scans while the angle φ is set to 90 degrees (inother words, while the infrared detector elements 263 a through 263 fare aligned in a straight line and not offset in the verticaldirection). When the target of interest is smaller than the verticalheight of the entire scanning range, the infrared detector 260 rotatesthe rotating structure 264 such that the target of interest is tightlycovered, and rescans with the detection areas 268 a through 268 freduced in vertical height. With this, a high-resolution target ofinterest infrared image (temperature distribution) is obtained.

The infrared detector 260 can also scan in vertical directions byrotation of an axle 261. Thus, even when the target of interest is aboveor below the scanning range, the infrared detector 260 is capable ofscanning only the location of the target of interest by adjusting theinfrared detector element array 262 vertically so as to match up withthe target of interest, and scanning in a vertical direction.

Note that when the infrared detector 260 knows the horizontal locationof the target of interest, horizontal scanning by the axle 204 may bestopped and vertical scanning by the axle 261 may be started. In thiscase as well, the infrared detector 260 is capable of obtaining an imagethat is two-dimensionally high in resolution by rotating the infrareddetector elements 263 a through 263 f about the rotating structure 264so as to match the vertical height of the target of interest.

Other Embodiment 4 Variations

The infrared detector element arrays 252 and 262 described in the abovevariations of Embodiment 4 are advantageous in that they can bemanufactured at very low cost. FIG. 56 illustrates a technique forcutting the infrared detector element array from a wafer.

Generally, infrared detector elements are manufactured by semiconductordevice fabrication. During manufacturing, when infrared detector elementarrays 271 such as the infrared detector element array 252 and 262, forexample, are cut from a wafer 270, it is possible to cut out multipleinfrared detector element arrays from a single wafer 270 since sides ofadjacent infrared detector elements are in contact with each other ineach infrared detector element array 271. In FIG. 56, six infrareddetector element arrays 271 are obtained from a single wafer 270. Theinfrared detector element arrays 252 and 262 are therefore advantageousin that they can be manufactured at low cost.

Note that the configuration described in Embodiment 4 is merely oneexample, and the number of infrared detector elements included in theinfrared detector element array, the driving structures of the axle 204and the axle 261, for example, or the rotating structure and such of therotating structure 264, for example, are not particularly limited.Various modifications may be made configuration so long as they do notdepart from the essence of the configuration. Moreover, the aboveembodiments or the variations thereof may be combined.

[Conclusion]

The thermal image sensor (infrared detector) according to Embodiment 4includes a plurality of infrared sensor elements that detect infraredlight in a detection area, and a scanning device which scans thedetection area in a scanning direction to detect, with the plurality ofinfrared detector elements, infrared light in an area to be captured asa single thermal image. The plurality of infrared detector elementsinclude infrared detector elements arranged in different positions inthe predetermined direction (for example, the rotational direction ofthe rotors 104 a through 104 f). Here, the predetermined direction isequivalent to the scanning direction in the arrangement of the pluralityof infrared detector elements.

For example, the plurality of infrared detector elements are aligned inan intersecting direction intersecting both the predetermined directionand a direction perpendicular to the predetermined direction, such as isthe case with the infrared detector element array 202.

For example, as illustrated in FIG. 52 and FIG. 55, the plurality ofinfrared detector elements may be arranged such that a detection rangeof one infrared detector element included in the plurality of infrareddetector elements overlaps a detection range of an adjacent infrareddetector element included in the plurality of infrared detectorelements, such as is the case with the infrared detector element array252. Here, the detection range refers to the range in which thedetection area moves when scanning is performed.

The scanning device in the thermal image sensor according to Embodiment4 may scan the detection area in the scanning direction by moving theplurality of infrared detector elements in the predetermined direction.In this case, the operating device is, for example, a driving structuresuch as the rotors 104 a through 104 f, or the axle 204.

The thermal image sensor according to Embodiment 4 may include anoptical system that introduces infrared light from a target object tothe plurality of infrared detector elements, and the scanning device mayscan the detection area in the scanning direction by moving the opticalsystem. In this case, the scanning device is, for example, a drivingstructure such as the axle 222.

The thermal image sensor according to Embodiment 4 may include aperpendicular scanning device that scans the detection range in adirection perpendicular to the scanning direction. The perpendicularscanning device is, for example, a driving structure such as the axle261.

The thermal image sensor according to Embodiment 4 may include astructure that adjusts an angle of the intersecting direction relativeto the predetermined direction by rotating the plurality of infrareddetector elements. This sort of structure is, for example, the rotatingstructure 264.

The thermal image sensor according to Embodiment 4 is lower in cost thanthe thermal image sensor 20 in which the infrared detector elements arearranged in a matrix, and more suited for measurement of an amount ofactivity of a person than the thermal image sensor 30 in which theinfrared detector elements are arranged in a line.

Embodiment 5

The infrared detector described in Embodiment 4 may be used in a deviceother than the air conditioner 100. In Embodiment 5, as one example, alighting device including an infrared detector will be described. FIG.57 is a diagrammatic view of a room in which a lighting device 300including an infrared detector 301 is installed in the ceiling. As oneexample, the person 102 and the desk 103 are present in the roomillustrated in FIG. 57.

Any of the infrared detectors 101, 200, 210, 220, 230, 240, 250, and 260described in Embodiment 4 may be used as the infrared detector 301included in the lighting device 300. The lighting device 300 includingthe infrared detector 301 is capable of, for example, estimating who aperson is based on the height of the detected person 102, and performinglighting control based on the result of the estimation.

For example, if light emission color preferences are registered inadvance, the lighting device 300 can change the color of the light(light emission color) based on the presence of the person estimated bythe infrared detector 301. As a simple example, the lighting device 300may turn the light on or off based on the presence of a person.Moreover, when the infrared detector 301 detects that a person iswatching television in the room, the lighting device 300 can dime thelight to increase visibility of the television screen.

When the infrared detector 301 determines that the person 102 is fallingasleep, the lighting device 300 may dim or turn off the light.Conversely, when the infrared detector 301 determines that the person102 is waking up, the lighting device 300 may turn on the light. Thissort of control is convenient and can reduce power consumption.

Note that the configuration described in Embodiment 5 is one example,and the detection result of the infrared detector 301 may be used tocontrol other aspects of the lighting device 300. Note that in FIG. 57,the lighting device 300 is installed in the ceiling, but the lightingdevice 300 may be installed in the wall.

In Embodiment 5, the infrared detector 301 is exemplified as beinginstalled in the lighting device 300, but the infrared detector 301 maybe installed in a device other than the lighting device 300. Forexample, the infrared detector 301 may be installed in a television. Inthis case, the television may use the infrared detector 301 to detect aviewer and suggest television programs based on the profile of thedetected viewer, or automatically turn off the television power when aviewer is not detected.

Other Embodiments

The present invention has hereinbefore been described based onEmbodiments 1 through 5, but the present invention is not limited tothese embodiments.

For example, in Embodiment 2, an example in which a plurality ofone-dimensional photosensors (element lines) are provided is mainlygiven, but the plurality of one-dimensional photosensors are notrequired to be disposed separated apart from each other. FIG. 58illustrates an example of a thermal image sensor including a pluralityof one-dimensional photosensors disposed adjacent to each other.

For example, the thermal image sensor 2900 a illustrated in (a) in FIG.58 includes two one-dimensional photosensors having photosensor elementsaligned in the Y axis direction. The two one-dimensional photosensors inthe thermal image sensor 2900 a are also disposed adjacent (contiguous)to each other in the X axis direction.

The thermal image sensor 2900 b illustrated in (b) in FIG. 58 includestwo one-dimensional photosensors having photosensor elements that areoffset in the Y axis direction by one-half the vertical height of aphotosensor element (the vertical height is labeled as “h” in FIG. 58).The two one-dimensional photosensors in the thermal image sensor 2900 bare also disposed adjacent to each other in the X axis direction.

The thermal image sensor 2900 c illustrated in (c) in FIG. 58 includesfour one-dimensional photosensors having photosensor elements that areoffset in the Y axis direction by one fourth the vertical height of aphotosensor element (the vertical height is labeled as “h” in FIG. 58).The four one-dimensional photosensors in the thermal image sensor 2900 care also disposed adjacent to each other in the X axis direction.

By offsetting the positioning of the photosensor elements like in thethermal image sensor 2900 b and the thermal image sensor 2900 c,high-resolution imaging as described above is possible.

Moreover, for example, the present invention may be implemented as anelectronics device (consumer electronics device), such as theabove-described air conditioner, vehicle air conditioner, lightingdevice, and television. Moreover, the present invention may beimplemented as a program for operating an information processing device,such as a smart phone, as a user interface (user interface device), or anon-transitory computer-readable recording medium having such a programstored thereon.

Each of the structural elements in each of the above-describedembodiments may be configured in the form of an exclusive hardwareproduct, or may be realized by executing a software program suitable forthe structural element. Each of the structural elements may be realizedby means of a program executing device, such as a CPU and a processor,reading and executing the software program recorded on a recordingmedium such as a hard disk or a semiconductor memory.

In each of the above-described embodiments, a process executed by aprescribed processor may be executed by a different processor. Moreover,the processing order of the processes may be changed, and the processesmay be performed in parallel. For example, the processes performed bythe computation processor included in the air conditioner may beperformed by the user interface (smart phone).

One or more configurations of the thermal image sensor (and userinterface) have herein been described based on the above embodiments,but the present invention is not limited to these embodiments. Variousmodifications of the exemplary embodiments as well as embodimentsresulting from arbitrary combinations of constituent elements ofdifferent exemplary embodiments that may be conceived by those skilledin the art are intended to be included within the scope of the presentinvention as long as these do not depart from the essence of the presentinvention.

INDUSTRIAL APPLICABILITY

The thermal image sensor according to the present invention isapplicable as a relatively low cost thermal image sensor that issuitable for measuring an amount of human activity.

REFERENCE SIGNS LIST

10, 10 a, 100 air conditioner

11 air inlet

12 air outlet

13 thermal image sensor

14 main body

15 frame memory

16 computation processor

16 a, 81 image processor

16 b device controller

17 environmental monitoring device

18 a heat exchanger

18 b blower

18 c air flow direction adjuster

19 communication device

20 thermal image sensor

21 two-dimensional photosensor

22, 2802 lens

30, 1000, 1300, 1400 a, 1400 b, 1500 a, 1500 b, 1500 c, 1500 d, 1600 a,1600 b, 1700 a, 1700 b, 1800 a, 1800 b, 2000 a, 2000 b, 2000 c, 2500,2700, 2800, 2900 a, 2900 b, 2900 c, 3101 thermal image sensor

31 rotator

32, 32 a, 32 b, 32 c one-dimensional photosensor

33 lens

41, 42 user

50, 91, 92 entire observation area

51, 1907, 1908, 1909, 2602 observation pixel

61, 61 a, 61 b, 61 c, 1910, 1911, 2101 linear observation area

70 user interface

71 first setting-receiver

72 second setting-receiver

73 third setting-receiver

74 display device

75 remote-control controller

76 remote control communication device

80 server

101, 110, 200, 210, 220, 230, 240, 250, 260, 301 infrared detector(thermal image sensor)

102 person

102 a left leg

102 b head

103 desk

104 a, 104 b, 104 c, 104 d, 104 e, 104 f rotor

105 a, 105 b, 105 c, 105 d, 105 e, 105 f, 108, 203 a, 203 b, 203 c, 203d, 203 e, 203 f, 253 a, 253 b, 253 c, 253 d, 253 e, 253 f, 258, 263 a,263 b, 263 c, 263 d, 263 e, 263 f infrared detector element

106 a, 106 b, 106 c, 106 d, 106 e, 106 f top surface

107 a, 107 b, 107 c, 107 d, 107 e, 107 f side surface

108 a, 108 b, 108 c, 108 d, 108 e, 108 f, 109 a, 109 b, 109 c, 109 d,109 e, 109 f, 258 a, 258 b, 258 c, 258 d, 258 e, 258 f, 268 a, 268 b,268 c, 268 d, 268 e, 268 f detection area

201 substrate

202, 252, 262, 271 infrared detector element array

204, 222, 241, 261 axle

205 imaging lens

221, 2801 mirror

231 mirror with lens

242 light

264 rotating structure

270 wafer

300 lighting device

1401 diagonal observation area

1401 a, 1501 a, 1501 b, 1501 c, 1501 d, 1601 a, 1601 b, 1701 a, 1701 b,1801 a, 1801 b first photosensor element line

1402 non-linear observation area

1402 a, 1502 a, 1502 b, 1502 c, 1502 d, 1602 a, 1602 b, 1702 a, 1702 b,1802 a, 1802 b second photosensor element line

1402 b second photosensor element group

1601, 1602, 1701, 1702 photosensor element

1901, 1902, 1903, 1904, 1905, 1906, 2601 partial observation pixel

2001, 2002, 2003, 2004 in-room fixed partition

2301 baffle

2701, 2803 photosensor

3000 compressor

3001 evaporator

3002 condenser

3003 receiver

3004 blower system

3005 intake system

3006 temperature sensor

3100, 3200, 3300 vehicle air conditioner

3102, 3201 observation area

3202 hygrometer

3203 windshield

3400 vehicle

3501 scattered light measurement system

3502 lighting system

3801 blinder

1-19. (canceled)
 20. A thermal image sensor comprising: a plurality ofinfrared detector elements that detect infrared light in a detectionarea; a scanning device that scans the detection area in a predetermineddirection to generate a thermal image based on information obtained byeach of the plurality of infrared detector elements; and at least onebaffle disposed in an area around the plurality of infrared detectorelements, wherein the plurality of infrared detector elements include afirst infrared detector element and a second infrared detector elementarranged in mutually different positions in the predetermined direction,the first infrared detector element and the second infrared detectorelement are arranged such that a portion of a first detection area and aportion of a second detection area overlap, the first detection areabeing an area in which the first infrared detector element detectsinfrared light by scanning by the scanning device, and the seconddetection area being an area in which the second infrared detectorelement detects infrared light by scanning by the scanning device, andthe at least one baffle is disposed in a manner to block infrared lightat an end of the detection area.
 21. The thermal image sensor accordingto claim 20, wherein the plurality of infrared detector elements arealigned in a first line extending in an intersecting directionintersecting both the predetermined direction and a directionperpendicular to the predetermined direction.
 22. The thermal imagesensor according to claim 21, wherein the first infrared detectorelement and the second infrared detector element are adjacent elementsin the first line.
 23. The thermal image sensor according to claim 21,wherein, relative to the predetermined direction, an angle of theintersecting direction in which the plurality of infrared detectorelements are aligned is 45 degrees.
 24. The thermal image sensoraccording to claim 20, wherein the plurality of infrared detectorelements are arranged in a plurality of element lines, and the pluralityof element lines are arranged in mutually different positions in thepredetermined direction.
 25. The thermal image sensor according to claim24, wherein the plurality of element lines include a first element lineand a second element line arranged in mutually different positions inthe predetermined direction, the first infrared detector element isincluded in the first element line, and the second infrared detectorelement is included in the second element line.
 26. The thermal imagesensor according to claim 25, wherein the first element line furtherincludes a third infrared detector element that is arranged in adifferent position than the first infrared detector element and detectsinfrared light in a third detection area by scanning by the scanningdevice, and the third infrared detector element is arranged such that aportion of the third detection area and a portion of the seconddetection area overlap.
 27. The thermal image sensor according to claim25, wherein the plurality of element lines include a third element linearranged in a different position in the predetermined direction than thefirst element line and the second element line, the first element line,the second element line, and the third element line are arranged instated order, and a distance between the first element line and thesecond element line is different from a distance between the secondelement line and the third element line.
 28. The thermal image sensoraccording to claim 24, wherein each of the plurality of element lines isconfigured of infrared detector elements aligned in a directionperpendicular to the predetermined direction.
 29. The thermal imagesensor according to claim 24, wherein the plurality of element linesinclude: an element line of infrared detector elements aligned in adirection perpendicular to the predetermined direction; and an elementline of infrared detector elements aligned in an intersecting directionintersecting both the predetermined direction and the directionperpendicular to the predetermined direction.
 30. The thermal imagesensor according to claim 24, wherein a number of infrared detectorelements constituting one element line included in the plurality ofelement lines is different from a number of infrared detector elementsconstituting another element line included in the plurality of elementlines.
 31. The thermal image sensor according to claim 20, wherein theplurality of infrared detector elements include two types of infrareddetector elements different in at least one of shape, thermal capacity,size, or material.
 32. The thermal image sensor according to claim 20,wherein the scanning device scans the detection area in thepredetermined direction by moving the plurality of infrared detectorelements in the predetermined direction.
 33. The thermal image sensoraccording to claim 20, further comprising an optical system thatintroduces infrared light from a target object to the plurality ofinfrared detector elements, wherein the scanning device scans thedetection area in the predetermined direction by moving the opticalsystem.
 34. The thermal image sensor according to claim 20, furthercomprising a perpendicular scanning device that scans the detection areain a direction perpendicular to the predetermined direction.
 35. Thethermal image sensor according to claim 21, further comprising astructure that adjusts an angle of the intersecting direction relativeto the predetermined direction by rotating the plurality of infrareddetector elements.
 36. The thermal image sensor according to claim 20,wherein the thermal image sensor detects a change in the thermal imageby comparing first infrared information detected for the first detectionarea at a first point in time by the first infrared detector element andsecond infrared information detected for the first detection area at asecond point in time by the second infrared detector element.
 37. A userinterface for an air conditioner including the thermal image sensoraccording to claim 20, wherein the thermal image sensor is a sensor forgenerating a thermal image showing a temperature distribution of atarget area, and the user interface comprises: a first setting-receiverthat receives a setting for a target temperature of a room; and a secondsetting-receiver that receives a setting for a target temperature of acertain part of the target area.
 38. The user interface according toclaim 37, further comprising a third setting-receiver that receives asetting for an air flow direction and a setting for a fan speed for theair conditioner, wherein when the setting for the target temperature forthe first setting-receiver is set and the setting for the targettemperature for the second setting-receiver is set, the thirdsetting-receiver refrains from receiving the setting for the air flowdirection and the setting for the fan speed.
 39. The user interfaceaccording to claim 38, further comprising a display device that displaysat least the air flow direction and the fan speed, wherein when thesetting for the target temperature for the first setting-receiver is setand the setting for the target temperature for the secondsetting-receiver is set, the display device displays that input of asetting to the third setting-receiver is not possible.
 40. The userinterface according to claim 39, wherein the air conditioner detects alocation of a person in the target area by image processing by thethermal image sensor, and the display device further displays atemperature at the location of the person detected by the airconditioner.
 41. The user interface according to claim 40, wherein thetemperature at the location of the person includes at least one of atemperature at a location of a face of the person, a temperature at alocation of a hand of the person, or a temperature at a location of aleg of the person.
 42. The user interface according to claim 41, whereinthe second setting-receiver receives, as the target temperature of thecertain part, a setting for a target temperature of at least one of alocation of a face of the person, a location of a hand of the person, ora location of a leg of the person.